Note: This is test shard 2 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/1
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250112 21:02:28.309268 22283 test_util.cc:274] Using random seed: -1522468606
2025-01-12T21:02:28Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-01-12T21:02:28Z Disabled control of system clock
I20250112 21:02:28.323633 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.254:46215
--webserver_interface=127.21.194.254
--webserver_port=0
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250112 21:02:28.422602 22291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:28.422839 22291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:28.422879 22291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:28.426000 22291 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250112 21:02:28.426057 22291 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250112 21:02:28.426076 22291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250112 21:02:28.426096 22291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:28.426177 22291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250112 21:02:28.426213 22291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250112 21:02:28.429996 22291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.254:46215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.194.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.22291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:28.430975 22291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:28.432008 22291 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:28.439064 22297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.439704 22296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.440184 22299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:28.440696 22291 server_base.cc:1034] running on GCE node
I20250112 21:02:28.441151 22291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:28.442011 22291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:28.443152 22291 hybrid_clock.cc:648] HybridClock initialized: now 1736715748443141 us; error 25 us; skew 500 ppm
I20250112 21:02:28.450016 22291 webserver.cc:458] Webserver started at http://127.21.194.254:33441/ using document root <none> and password file <none>
I20250112 21:02:28.450578 22291 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:28.450632 22291 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:28.450806 22291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250112 21:02:28.452450 22291 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/instance:
uuid: "81853a8db6f14748910205ef23843fa0"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.452898 22291 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal/instance:
uuid: "81853a8db6f14748910205ef23843fa0"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.455994 22291 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:28.457957 22305 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:28.458884 22291 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:28.458985 22291 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
uuid: "81853a8db6f14748910205ef23843fa0"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.459062 22291 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:28.482125 22291 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:28.482759 22291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:28.482913 22291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:28.488993 22291 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.254:46215
I20250112 21:02:28.489007 22357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.254:46215 every 8 connection(s)
I20250112 21:02:28.489910 22291 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
I20250112 21:02:28.492702 22358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:28.495575 22358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.498665 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22291
I20250112 21:02:28.498807 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal/instance
I20250112 21:02:28.500505 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.253:36663
--webserver_interface=127.21.194.253
--webserver_port=0
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250112 21:02:28.505683 22358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } has no permanent_uuid. Determining permanent_uuid...
W20250112 21:02:28.506397 22308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.194.253:36663: connect: Connection refused (error 111)
W20250112 21:02:28.507164 22358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.253:36663: Network error: Client connection negotiation failed: client connection to 127.21.194.253:36663: connect: Connection refused (error 111)
I20250112 21:02:28.556370 22358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } attempt: 1
W20250112 21:02:28.557730 22358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.253:36663: Network error: Client connection negotiation failed: client connection to 127.21.194.253:36663: connect: Connection refused (error 111)
W20250112 21:02:28.603572 22362 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:28.603806 22362 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:28.603855 22362 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:28.606943 22362 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250112 21:02:28.606995 22362 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250112 21:02:28.607017 22362 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250112 21:02:28.607050 22362 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:28.607081 22362 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250112 21:02:28.607115 22362 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250112 21:02:28.610809 22362 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.253:36663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.194.253
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.22362
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:28.611788 22362 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:28.612874 22362 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:28.619684 22369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.620096 22368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.620576 22371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:28.621345 22362 server_base.cc:1034] running on GCE node
I20250112 21:02:28.621812 22362 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:28.622651 22362 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:28.623795 22362 hybrid_clock.cc:648] HybridClock initialized: now 1736715748623784 us; error 24 us; skew 500 ppm
I20250112 21:02:28.625587 22362 webserver.cc:458] Webserver started at http://127.21.194.253:43893/ using document root <none> and password file <none>
I20250112 21:02:28.625890 22358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } attempt: 2
I20250112 21:02:28.626123 22362 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:28.626179 22362 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:28.626348 22362 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
W20250112 21:02:28.627115 22358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.253:36663: Network error: Client connection negotiation failed: client connection to 127.21.194.253:36663: connect: Connection refused (error 111)
I20250112 21:02:28.628077 22362 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data/instance:
uuid: "466a54ef09a44559a1a0ee7c76bdf4c8"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.628558 22362 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal/instance:
uuid: "466a54ef09a44559a1a0ee7c76bdf4c8"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.631573 22362 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:28.633513 22377 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:28.634435 22362 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:28.634541 22362 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal
uuid: "466a54ef09a44559a1a0ee7c76bdf4c8"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.634615 22362 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:28.646574 22362 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:28.647120 22362 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:28.647269 22362 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:28.653424 22362 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.253:36663
I20250112 21:02:28.653432 22429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.253:36663 every 8 connection(s)
I20250112 21:02:28.654326 22362 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/data/info.pb
I20250112 21:02:28.655282 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22362
I20250112 21:02:28.655367 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-1/wal/instance
I20250112 21:02:28.655954 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.252:40219
--webserver_interface=127.21.194.252
--webserver_port=0
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250112 21:02:28.657220 22430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:28.660197 22430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.668571 22430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.673867 22430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } has no permanent_uuid. Determining permanent_uuid...
W20250112 21:02:28.674536 22379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
W20250112 21:02:28.675321 22430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.252:40219: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
I20250112 21:02:28.718261 22358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } attempt: 3
I20250112 21:02:28.722532 22358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } has no permanent_uuid. Determining permanent_uuid...
W20250112 21:02:28.723758 22358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.252:40219: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
I20250112 21:02:28.724510 22430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } attempt: 1
W20250112 21:02:28.725498 22430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.252:40219: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
I20250112 21:02:28.754905 22358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } attempt: 1
W20250112 21:02:28.756331 22358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.252:40219: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
W20250112 21:02:28.760010 22432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:28.760283 22432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:28.760350 22432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:28.763486 22432 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250112 21:02:28.763538 22432 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250112 21:02:28.763564 22432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250112 21:02:28.763598 22432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:28.763633 22432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250112 21:02:28.763664 22432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250112 21:02:28.767465 22432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.252:40219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.194.252
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.22432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:28.768585 22432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:28.769676 22432 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:28.776820 22441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.777457 22440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:28.777868 22443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:28.778458 22432 server_base.cc:1034] running on GCE node
I20250112 21:02:28.778926 22432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:28.779765 22432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:28.780916 22432 hybrid_clock.cc:648] HybridClock initialized: now 1736715748780905 us; error 27 us; skew 500 ppm
I20250112 21:02:28.782737 22432 webserver.cc:458] Webserver started at http://127.21.194.252:39967/ using document root <none> and password file <none>
I20250112 21:02:28.783252 22432 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:28.783300 22432 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:28.783444 22432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250112 21:02:28.785051 22432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data/instance:
uuid: "a8456e9572be47fabce002f001805c33"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.785460 22432 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal/instance:
uuid: "a8456e9572be47fabce002f001805c33"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.788532 22432 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250112 21:02:28.790467 22449 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:28.791390 22432 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:28.791489 22432 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal
uuid: "a8456e9572be47fabce002f001805c33"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:28.791559 22432 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:28.793628 22430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } attempt: 2
W20250112 21:02:28.794828 22430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.194.252:40219: Network error: Client connection negotiation failed: client connection to 127.21.194.252:40219: connect: Connection refused (error 111)
I20250112 21:02:28.806366 22432 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:28.806937 22432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:28.807078 22432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:28.813093 22432 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.252:40219
I20250112 21:02:28.813100 22501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.252:40219 every 8 connection(s)
I20250112 21:02:28.814004 22432 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/data/info.pb
I20250112 21:02:28.816776 22502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:28.819659 22502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.820986 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22432
I20250112 21:02:28.821069 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-2/wal/instance
I20250112 21:02:28.828251 22502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.831521 22358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } attempt: 2
I20250112 21:02:28.832628 22502 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } has no permanent_uuid. Determining permanent_uuid...
I20250112 21:02:28.839738 22502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Bootstrap starting.
I20250112 21:02:28.839740 22358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Bootstrap starting.
I20250112 21:02:28.842296 22502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:28.842530 22358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:28.843117 22502 log.cc:826] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:28.843137 22358 log.cc:826] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:28.844811 22358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: No bootstrap required, opened a new log
I20250112 21:02:28.844897 22502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: No bootstrap required, opened a new log
I20250112 21:02:28.847168 22358 raft_consensus.cc:357] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.847170 22502 raft_consensus.cc:357] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.847313 22502 raft_consensus.cc:383] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:28.847317 22358 raft_consensus.cc:383] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:28.847348 22502 raft_consensus.cc:738] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8456e9572be47fabce002f001805c33, State: Initialized, Role: FOLLOWER
I20250112 21:02:28.847371 22358 raft_consensus.cc:738] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81853a8db6f14748910205ef23843fa0, State: Initialized, Role: FOLLOWER
I20250112 21:02:28.847725 22358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.847735 22502 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.848102 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.848101 22513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.848217 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:28.848342 22513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:28.848776 22358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: configured and running, proceeding with master startup.
I20250112 21:02:28.848776 22502 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: configured and running, proceeding with master startup.
W20250112 21:02:28.853708 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.853802 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.853629 22291 master_runner.cc:186] Error getting master registration for 127.21.194.253:36663: OK, instance_id { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" instance_seqno: 1736715748651707 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250112 21:02:28.856088 22291 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250112 21:02:28.856657 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.856751 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.854560 22432 master_runner.cc:186] Error getting master registration for 127.21.194.253:36663: OK, instance_id { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" instance_seqno: 1736715748651707 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250112 21:02:28.856981 22432 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250112 21:02:28.864565 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.864639 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.867415 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.867486 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.875244 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.875319 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.878082 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.878152 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.885941 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.886008 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.885973 22430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } attempt: 3
W20250112 21:02:28.888788 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.888856 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.892710 22430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: Bootstrap starting.
I20250112 21:02:28.895536 22430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:28.896539 22430 log.cc:826] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: Log is configured to *not* fsync() on all Append() calls
W20250112 21:02:28.896667 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.896728 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.898921 22430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: No bootstrap required, opened a new log
W20250112 21:02:28.899464 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.899530 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.902333 22430 raft_consensus.cc:357] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.902518 22430 raft_consensus.cc:383] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:28.902570 22430 raft_consensus.cc:738] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 466a54ef09a44559a1a0ee7c76bdf4c8, State: Initialized, Role: FOLLOWER
I20250112 21:02:28.903012 22430 consensus_queue.cc:260] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.903473 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.903683 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:28.904191 22430 sys_catalog.cc:564] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: configured and running, proceeding with master startup.
W20250112 21:02:28.907337 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.907405 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.910104 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.910171 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.910396 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.910497 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.911048 22513 raft_consensus.cc:491] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:28.911211 22513 raft_consensus.cc:513] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.912144 22513 leader_election.cc:290] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 466a54ef09a44559a1a0ee7c76bdf4c8 (127.21.194.253:36663), a8456e9572be47fabce002f001805c33 (127.21.194.252:40219)
I20250112 21:02:28.912741 22475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8456e9572be47fabce002f001805c33" is_pre_election: true
I20250112 21:02:28.912957 22404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" is_pre_election: true
I20250112 21:02:28.913007 22475 raft_consensus.cc:2463] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81853a8db6f14748910205ef23843fa0 in term 0.
I20250112 21:02:28.913184 22404 raft_consensus.cc:2463] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81853a8db6f14748910205ef23843fa0 in term 0.
I20250112 21:02:28.913561 22307 leader_election.cc:304] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81853a8db6f14748910205ef23843fa0, a8456e9572be47fabce002f001805c33; no voters:
I20250112 21:02:28.916903 22362 master_runner.cc:263] No leader master found from master 466a54ef09a44559a1a0ee7c76bdf4c8
I20250112 21:02:28.916970 22362 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250112 21:02:28.917060 22513 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:28.917131 22513 raft_consensus.cc:491] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:28.917176 22513 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:28.918251 22513 raft_consensus.cc:513] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.918612 22513 leader_election.cc:290] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 1 election: Requested vote from peers 466a54ef09a44559a1a0ee7c76bdf4c8 (127.21.194.253:36663), a8456e9572be47fabce002f001805c33 (127.21.194.252:40219)
W20250112 21:02:28.919512 22535 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.919579 22535 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.920114 22404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8"
I20250112 21:02:28.920243 22404 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:28.920845 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.920905 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.921305 22404 raft_consensus.cc:2463] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81853a8db6f14748910205ef23843fa0 in term 1.
W20250112 21:02:28.921909 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.921973 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.922183 22308 leader_election.cc:304] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 466a54ef09a44559a1a0ee7c76bdf4c8, 81853a8db6f14748910205ef23843fa0; no voters:
I20250112 21:02:28.922397 22475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8456e9572be47fabce002f001805c33"
I20250112 21:02:28.922513 22475 raft_consensus.cc:3054] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:28.923517 22475 raft_consensus.cc:2463] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81853a8db6f14748910205ef23843fa0 in term 1.
I20250112 21:02:28.923961 22513 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:28.924180 22513 raft_consensus.cc:695] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 LEADER]: Becoming Leader. State: Replica: 81853a8db6f14748910205ef23843fa0, State: Running, Role: LEADER
I20250112 21:02:28.924510 22513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:28.928668 22513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81853a8db6f14748910205ef23843fa0. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.928833 22513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: LEADER
I20250112 21:02:28.929250 22555 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250112 21:02:28.930230 22555 catalog_manager.cc:1485] Initializing Kudu cluster ID...
W20250112 21:02:28.931473 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.931548 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.932607 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.932669 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.937245 22475 raft_consensus.cc:1270] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Refusing update from remote peer 81853a8db6f14748910205ef23843fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:28.937876 22553 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:28.941614 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81853a8db6f14748910205ef23843fa0. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.941715 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: FOLLOWER
W20250112 21:02:28.942157 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.942215 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.942721 22404 raft_consensus.cc:1270] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Refusing update from remote peer 81853a8db6f14748910205ef23843fa0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250112 21:02:28.943877 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.943930 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.945914 22553 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:28.949208 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81853a8db6f14748910205ef23843fa0. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.949306 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: This master's current role is: FOLLOWER
W20250112 21:02:28.952847 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.952908 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.953438 22553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.953533 22553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: LEADER
W20250112 21:02:28.954535 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.954594 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.955368 22514 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.955474 22514 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:28.955868 22556 mvcc.cc:204] Tried to move back new op lower bound from 7113587707640082432 to 7113587707605061632. Current Snapshot: MvccSnapshot[applied={T|T < 7113587707640082432}]
I20250112 21:02:28.956229 22557 mvcc.cc:204] Tried to move back new op lower bound from 7113587707640082432 to 7113587707605061632. Current Snapshot: MvccSnapshot[applied={T|T < 7113587707640082432}]
I20250112 21:02:28.958184 22513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.958283 22513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: LEADER
I20250112 21:02:28.959757 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "81853a8db6f14748910205ef23843fa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:28.959853 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:28.963304 22555 catalog_manager.cc:1348] Generated new cluster ID: b7211684857f4b4e9f02b932b4cfb770
I20250112 21:02:28.963358 22555 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
W20250112 21:02:28.963689 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.963742 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.968900 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.968962 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.974336 22536 catalog_manager.cc:1559] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.974402 22536 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.979664 22551 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250112 21:02:28.979725 22551 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.983497 22555 catalog_manager.cc:1371] Generated new certificate authority record
I20250112 21:02:28.985154 22536 catalog_manager.cc:1260] Loaded cluster ID: b7211684857f4b4e9f02b932b4cfb770
I20250112 21:02:28.985211 22536 catalog_manager.cc:1553] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: loading cluster ID for follower catalog manager: success
I20250112 21:02:28.986567 22555 catalog_manager.cc:1505] Loading token signing keys...
I20250112 21:02:28.987313 22536 catalog_manager.cc:1575] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: acquiring CA information for follower catalog manager: success
W20250112 21:02:28.987876 22536 catalog_manager.cc:874] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250112 21:02:28.990636 22551 catalog_manager.cc:1260] Loaded cluster ID: b7211684857f4b4e9f02b932b4cfb770
I20250112 21:02:28.990690 22551 catalog_manager.cc:1553] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: loading cluster ID for follower catalog manager: success
W20250112 21:02:28.991117 22551 catalog_manager.cc:1577] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20250112 21:02:28.991179 22551 catalog_manager.cc:874] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
W20250112 21:02:28.998601 22536 catalog_manager.cc:874] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250112 21:02:29.009466 22551 catalog_manager.cc:1575] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: acquiring CA information for follower catalog manager: success
W20250112 21:02:29.010110 22551 catalog_manager.cc:874] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250112 21:02:29.010164 22536 catalog_manager.cc:1603] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250112 21:02:29.010919 22555 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Generated new TSK 0
I20250112 21:02:29.011684 22555 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250112 21:02:29.021818 22551 catalog_manager.cc:1603] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250112 21:02:29.026737 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.194.193:0
--local_ip_for_outbound_sockets=127.21.194.193
--webserver_interface=127.21.194.193
--webserver_port=0
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20250112 21:02:29.146011 22565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:29.146201 22565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:29.146247 22565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:29.149545 22565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:29.149645 22565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.194.193
I20250112 21:02:29.153368 22565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.194.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.194.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--never_fsync=true
--heap_profile_path=/tmp/kudu.22565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.194.193
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:29.154269 22565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:29.155272 22565 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:29.162957 22570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.163471 22573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.163831 22571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:29.164655 22565 server_base.cc:1034] running on GCE node
I20250112 21:02:29.164979 22565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:29.165488 22565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:29.166625 22565 hybrid_clock.cc:648] HybridClock initialized: now 1736715749166610 us; error 29 us; skew 500 ppm
I20250112 21:02:29.168263 22565 webserver.cc:458] Webserver started at http://127.21.194.193:35245/ using document root <none> and password file <none>
I20250112 21:02:29.168838 22565 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:29.168892 22565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:29.169070 22565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250112 21:02:29.170801 22565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data/instance:
uuid: "d8faec3969b64c33a4bf9aba509785ea"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.171242 22565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/instance:
uuid: "d8faec3969b64c33a4bf9aba509785ea"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.174314 22565 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20250112 21:02:29.176187 22579 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.177143 22565 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:29.177238 22565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal
uuid: "d8faec3969b64c33a4bf9aba509785ea"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.177311 22565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:29.199018 22565 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:29.199554 22565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:29.199698 22565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:29.200227 22565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250112 21:02:29.201133 22565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250112 21:02:29.201179 22565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.201229 22565 ts_tablet_manager.cc:610] Registered 0 tablets
I20250112 21:02:29.201257 22565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.208978 22565 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.193:40893
I20250112 21:02:29.209003 22692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.193:40893 every 8 connection(s)
I20250112 21:02:29.209867 22565 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/data/info.pb
I20250112 21:02:29.212919 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22565
I20250112 21:02:29.213038 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/instance
I20250112 21:02:29.215463 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.194.194:0
--local_ip_for_outbound_sockets=127.21.194.194
--webserver_interface=127.21.194.194
--webserver_port=0
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250112 21:02:29.220290 22694 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:29.220466 22695 heartbeater.cc:346] Connected to a master server at 127.21.194.253:36663
I20250112 21:02:29.220526 22694 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.220526 22695 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.221108 22694 heartbeater.cc:510] Master 127.21.194.254:46215 requested a full tablet report, sending...
I20250112 21:02:29.221108 22695 heartbeater.cc:510] Master 127.21.194.253:36663 requested a full tablet report, sending...
I20250112 21:02:29.222427 22394 ts_manager.cc:194] Registered new tserver with Master: d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:29.222493 22321 ts_manager.cc:194] Registered new tserver with Master: d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:29.224054 22321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.194.193:48773
I20250112 21:02:29.225090 22693 heartbeater.cc:346] Connected to a master server at 127.21.194.252:40219
I20250112 21:02:29.225178 22693 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.225378 22693 heartbeater.cc:510] Master 127.21.194.252:40219 requested a full tablet report, sending...
I20250112 21:02:29.226174 22466 ts_manager.cc:194] Registered new tserver with Master: d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:29.319562 22700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:29.319753 22700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:29.319801 22700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:29.322824 22700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:29.322924 22700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.194.194
I20250112 21:02:29.326443 22700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.194.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.194.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--never_fsync=true
--heap_profile_path=/tmp/kudu.22700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.194.194
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:29.327348 22700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:29.328351 22700 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:29.336130 22705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.336892 22706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.337477 22708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:29.338014 22700 server_base.cc:1034] running on GCE node
I20250112 21:02:29.338382 22700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:29.338892 22700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:29.340034 22700 hybrid_clock.cc:648] HybridClock initialized: now 1736715749340023 us; error 26 us; skew 500 ppm
I20250112 21:02:29.341786 22700 webserver.cc:458] Webserver started at http://127.21.194.194:43213/ using document root <none> and password file <none>
I20250112 21:02:29.342305 22700 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:29.342360 22700 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:29.342528 22700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250112 21:02:29.344115 22700 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data/instance:
uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.344590 22700 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/instance:
uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.347640 22700 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20250112 21:02:29.349645 22714 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.350586 22700 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:29.350677 22700 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal
uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.350764 22700 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:29.364607 22700 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:29.365068 22700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:29.365198 22700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:29.365658 22700 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250112 21:02:29.366446 22700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250112 21:02:29.366489 22700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.366549 22700 ts_tablet_manager.cc:610] Registered 0 tablets
I20250112 21:02:29.366575 22700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.374135 22700 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.194:41011
I20250112 21:02:29.374161 22827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.194:41011 every 8 connection(s)
I20250112 21:02:29.374944 22700 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/data/info.pb
I20250112 21:02:29.380872 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22700
I20250112 21:02:29.380961 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/instance
I20250112 21:02:29.383720 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.194.195:0
--local_ip_for_outbound_sockets=127.21.194.195
--webserver_interface=127.21.194.195
--webserver_port=0
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250112 21:02:29.385052 22829 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:29.385280 22830 heartbeater.cc:346] Connected to a master server at 127.21.194.253:36663
I20250112 21:02:29.385285 22829 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.385376 22830 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.385848 22829 heartbeater.cc:510] Master 127.21.194.254:46215 requested a full tablet report, sending...
I20250112 21:02:29.385848 22830 heartbeater.cc:510] Master 127.21.194.253:36663 requested a full tablet report, sending...
I20250112 21:02:29.386420 22828 heartbeater.cc:346] Connected to a master server at 127.21.194.252:40219
I20250112 21:02:29.386549 22828 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.386766 22828 heartbeater.cc:510] Master 127.21.194.252:40219 requested a full tablet report, sending...
I20250112 21:02:29.386783 22321 ts_manager.cc:194] Registered new tserver with Master: 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:29.386793 22394 ts_manager.cc:194] Registered new tserver with Master: 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:29.387377 22466 ts_manager.cc:194] Registered new tserver with Master: 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:29.387434 22321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.194.194:36929
W20250112 21:02:29.485852 22835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:29.486052 22835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:29.486109 22835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250112 21:02:29.489290 22835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:29.489413 22835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.194.195
I20250112 21:02:29.493026 22835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.194.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.194.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--never_fsync=true
--heap_profile_path=/tmp/kudu.22835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.194.195
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:29.493970 22835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:29.494987 22835 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250112 21:02:29.502956 22840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.503518 22841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:29.504072 22843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:29.504611 22835 server_base.cc:1034] running on GCE node
I20250112 21:02:29.505005 22835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:29.505570 22835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:29.506724 22835 hybrid_clock.cc:648] HybridClock initialized: now 1736715749506724 us; error 39 us; skew 500 ppm
I20250112 21:02:29.508248 22847 raft_consensus.cc:491] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81853a8db6f14748910205ef23843fa0)
I20250112 21:02:29.508345 22847 raft_consensus.cc:513] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:29.508488 22835 webserver.cc:458] Webserver started at http://127.21.194.195:39539/ using document root <none> and password file <none>
I20250112 21:02:29.509037 22835 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:29.509102 22835 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:29.509301 22835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250112 21:02:29.509495 22847 leader_election.cc:290] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215), a8456e9572be47fabce002f001805c33 (127.21.194.252:40219)
I20250112 21:02:29.509596 22332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "81853a8db6f14748910205ef23843fa0" is_pre_election: true
I20250112 21:02:29.509706 22475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a8456e9572be47fabce002f001805c33" is_pre_election: true
I20250112 21:02:29.510186 22379 leader_election.cc:304] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 466a54ef09a44559a1a0ee7c76bdf4c8; no voters: 81853a8db6f14748910205ef23843fa0, a8456e9572be47fabce002f001805c33
I20250112 21:02:29.510421 22847 raft_consensus.cc:2743] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250112 21:02:29.511183 22835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data/instance:
uuid: "3423673c659e4427958b13fc9eaa714d"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.511605 22835 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/instance:
uuid: "3423673c659e4427958b13fc9eaa714d"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.514734 22835 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20250112 21:02:29.516695 22850 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.517619 22835 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:29.517709 22835 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal
uuid: "3423673c659e4427958b13fc9eaa714d"
format_stamp: "Formatted at 2025-01-12 21:02:29 on dist-test-slave-26c7"
I20250112 21:02:29.517789 22835 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:29.538383 22835 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:29.538969 22835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:29.539121 22835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:29.539625 22835 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250112 21:02:29.540546 22835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250112 21:02:29.540592 22835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.540644 22835 ts_tablet_manager.cc:610] Registered 0 tablets
I20250112 21:02:29.540669 22835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:29.548326 22835 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.195:42913
I20250112 21:02:29.548367 22963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.195:42913 every 8 connection(s)
I20250112 21:02:29.549221 22835 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/data/info.pb
I20250112 21:02:29.549896 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 22835
I20250112 21:02:29.549997 22283 external_mini_cluster.cc:1427] Reading /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/instance
I20250112 21:02:29.559405 22966 heartbeater.cc:346] Connected to a master server at 127.21.194.253:36663
I20250112 21:02:29.559458 22965 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:29.559624 22966 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.559624 22965 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.560218 22966 heartbeater.cc:510] Master 127.21.194.253:36663 requested a full tablet report, sending...
I20250112 21:02:29.560289 22964 heartbeater.cc:346] Connected to a master server at 127.21.194.252:40219
I20250112 21:02:29.560421 22964 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:29.560218 22965 heartbeater.cc:510] Master 127.21.194.254:46215 requested a full tablet report, sending...
I20250112 21:02:29.560601 22964 heartbeater.cc:510] Master 127.21.194.252:40219 requested a full tablet report, sending...
I20250112 21:02:29.561235 22321 ts_manager.cc:194] Registered new tserver with Master: 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:29.561347 22394 ts_manager.cc:194] Registered new tserver with Master: 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:29.561861 22321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.194.195:56199
I20250112 21:02:29.562302 22466 ts_manager.cc:194] Registered new tserver with Master: 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:29.569705 22283 external_mini_cluster.cc:934] 3 TS(s) registered with all masters
I20250112 21:02:29.581969 22283 external_mini_cluster.cc:1620] Killing /tmp/dist-test-task2b0lOt/build/debug/bin/kudu with pid 22291
W20250112 21:02:29.587774 22974 connection.cc:537] client connection to 127.21.194.254:46215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250112 21:02:29.588248 22974 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.194.254:46215)
I20250112 21:02:29.726498 22694 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
W20250112 21:02:29.727335 22694 heartbeater.cc:643] Failed to heartbeat to 127.21.194.254:46215 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:29.889232 22829 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
W20250112 21:02:29.890023 22829 heartbeater.cc:643] Failed to heartbeat to 127.21.194.254:46215 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:29.988317 23011 raft_consensus.cc:491] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 81853a8db6f14748910205ef23843fa0)
I20250112 21:02:29.988471 23011 raft_consensus.cc:513] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:29.989316 23011 leader_election.cc:290] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215), 466a54ef09a44559a1a0ee7c76bdf4c8 (127.21.194.253:36663)
I20250112 21:02:29.989805 22404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8456e9572be47fabce002f001805c33" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" is_pre_election: true
W20250112 21:02:29.989852 22453 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:29.989938 22404 raft_consensus.cc:2463] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8456e9572be47fabce002f001805c33 in term 1.
I20250112 21:02:29.990268 22452 leader_election.cc:304] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 466a54ef09a44559a1a0ee7c76bdf4c8, a8456e9572be47fabce002f001805c33; no voters:
I20250112 21:02:29.990492 23011 raft_consensus.cc:2798] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250112 21:02:29.990538 23011 raft_consensus.cc:491] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 81853a8db6f14748910205ef23843fa0)
I20250112 21:02:29.990620 23011 raft_consensus.cc:3054] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 1 FOLLOWER]: Advancing to term 2
W20250112 21:02:29.990602 22453 leader_election.cc:336] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215): Network error: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:29.995977 23011 raft_consensus.cc:513] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:29.996505 23011 leader_election.cc:290] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 election: Requested vote from peers 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215), 466a54ef09a44559a1a0ee7c76bdf4c8 (127.21.194.253:36663)
I20250112 21:02:29.996795 22404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8456e9572be47fabce002f001805c33" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8"
I20250112 21:02:29.996907 22404 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 1 FOLLOWER]: Advancing to term 2
W20250112 21:02:29.997288 22453 leader_election.cc:336] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215): Network error: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:29.997820 22404 raft_consensus.cc:2463] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8456e9572be47fabce002f001805c33 in term 2.
I20250112 21:02:29.998098 22452 leader_election.cc:304] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 466a54ef09a44559a1a0ee7c76bdf4c8, a8456e9572be47fabce002f001805c33; no voters: 81853a8db6f14748910205ef23843fa0
I20250112 21:02:29.998261 23011 raft_consensus.cc:2798] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 2 FOLLOWER]: Leader election won for term 2
I20250112 21:02:29.998415 23011 raft_consensus.cc:695] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [term 2 LEADER]: Becoming Leader. State: Replica: a8456e9572be47fabce002f001805c33, State: Running, Role: LEADER
I20250112 21:02:29.998698 23011 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:30.000303 23014 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8456e9572be47fabce002f001805c33. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:30.000393 23014 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: LEADER
I20250112 21:02:30.000694 23015 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250112 21:02:30.001674 23015 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250112 21:02:30.002023 23015 catalog_manager.cc:1260] Loaded cluster ID: b7211684857f4b4e9f02b932b4cfb770
I20250112 21:02:30.002068 23015 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250112 21:02:30.002599 23015 catalog_manager.cc:1505] Loading token signing keys...
I20250112 21:02:30.002961 23015 catalog_manager.cc:5910] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Loaded TSK: 0
I20250112 21:02:30.003669 23015 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250112 21:02:30.036767 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_0cbef492272249838694852278b8c00d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.036881 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_031983b743244bf79af5d935dde01f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.036978 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_4807688dc4724f388533a12c9b7f8b46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.037014 22457 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_b256ce8159f249bc916313ea2b7b7008"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.036769 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f9cc8ce3fae24ce99c2fb46ad561cb41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.037293 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_721f2d0ed9e74375b175eae815067046"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.037319 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_d14240140a7e4785a9506aec5068cf63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.036902 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_bfdcd784c5c54db48d33306600a8da93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.036767 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_30902205854d4cd6b5d2a449ac5a0e93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.037533 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_1650c2f5a90c44fbb758e81436ec99b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.038034 22457 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b256ce8159f249bc916313ea2b7b7008 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038069 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfdcd784c5c54db48d33306600a8da93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038107 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_721f2d0ed9e74375b175eae815067046 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038040 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1650c2f5a90c44fbb758e81436ec99b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038197 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9cc8ce3fae24ce99c2fb46ad561cb41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038331 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_031983b743244bf79af5d935dde01f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038527 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d14240140a7e4785a9506aec5068cf63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038583 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4807688dc4724f388533a12c9b7f8b46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.038655 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cbef492272249838694852278b8c00d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.040915 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30902205854d4cd6b5d2a449ac5a0e93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.041795 22404 raft_consensus.cc:1270] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [term 2 FOLLOWER]: Refusing update from remote peer a8456e9572be47fabce002f001805c33: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20250112 21:02:30.042291 23011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250112 21:02:30.042623 22453 consensus_peers.cc:487] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 -> Peer 81853a8db6f14748910205ef23843fa0 (127.21.194.254:46215): Couldn't send request to peer 81853a8db6f14748910205ef23843fa0. Status: Network error: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:30.044193 23017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8456e9572be47fabce002f001805c33. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:30.044575 23017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:30.045619 23014 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:30.045723 23014 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: LEADER
I20250112 21:02:30.047719 23018 mvcc.cc:204] Tried to move back new op lower bound from 7113587712171499520 to 7113587711998459904. Current Snapshot: MvccSnapshot[applied={T|T < 7113587712171499520}]
I20250112 21:02:30.047868 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f9cc8ce3fae24ce99c2fb46ad561cb41" } new_table_name: "default.Table_d3fc8154d5774a0b96e21a98b2167cd5" modify_external_catalogs: true
I20250112 21:02:30.049079 23017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:30.049177 23017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 466a54ef09a44559a1a0ee7c76bdf4c8 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:30.049289 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_b256ce8159f249bc916313ea2b7b7008" } new_table_name: "default.Table_6be0636837894cf080f67f077d712ded" modify_external_catalogs: true
I20250112 21:02:30.051338 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d14240140a7e4785a9506aec5068cf63" } new_table_name: "default.Table_164ef4de2e7b46f28bea058a95e8afb8" modify_external_catalogs: true
I20250112 21:02:30.053769 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_4807688dc4724f388533a12c9b7f8b46" } new_table_name: "default.Table_b578d56d989e4975bf70943e78b9b84e" modify_external_catalogs: true
I20250112 21:02:30.053970 22463 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_031983b743244bf79af5d935dde01f0a" } modify_external_catalogs: true
I20250112 21:02:30.054081 22463 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_031983b743244bf79af5d935dde01f0a" } modify_external_catalogs: true
I20250112 21:02:30.054530 22459 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_721f2d0ed9e74375b175eae815067046" } new_table_name: "default.Table_badce8415eba41c2a5f23fc78f823476" modify_external_catalogs: true
I20250112 21:02:30.054919 22458 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_1650c2f5a90c44fbb758e81436ec99b2" } modify_external_catalogs: true
I20250112 21:02:30.055006 22458 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_1650c2f5a90c44fbb758e81436ec99b2" } modify_external_catalogs: true
I20250112 21:02:30.055325 22464 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0cbef492272249838694852278b8c00d" } modify_external_catalogs: true
I20250112 21:02:30.055413 22464 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0cbef492272249838694852278b8c00d" } modify_external_catalogs: true
I20250112 21:02:30.055634 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bfdcd784c5c54db48d33306600a8da93" } modify_external_catalogs: true
I20250112 21:02:30.055718 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bfdcd784c5c54db48d33306600a8da93" } modify_external_catalogs: true
W20250112 21:02:30.057391 22461 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0aab6c5a34b4b99ae922d2586a4714d consensus state has no leader
W20250112 21:02:30.058605 22457 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 has no consensus state
W20250112 21:02:30.059851 22462 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 505606e672b7403b81e9af1d6d954b3f has no consensus state
I20250112 21:02:30.060364 22462 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_6be0636837894cf080f67f077d712ded" } modify_external_catalogs: true
I20250112 21:02:30.060489 22462 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_6be0636837894cf080f67f077d712ded" } modify_external_catalogs: true
I20250112 21:02:30.062341 22463 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b3ea656314bb443daa6790edb5af599e
I20250112 21:02:30.063076 22458 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3c6456a18366489caa26e71eb77fa608
W20250112 21:02:30.063124 22459 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80e4e7addcca4efe9698cd08bcec5aa8 has no consensus state
W20250112 21:02:30.063321 22465 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76729244dcd340bda0953dc70171dd32 has no consensus state
I20250112 21:02:30.063385 22965 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
I20250112 21:02:30.064319 22464 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 450eb6aa77674aa6b5fd58b95efacfff
I20250112 21:02:30.064729 22460 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 53fd7a54c1f547c6a57c138f6144bcec
W20250112 21:02:30.066485 22965 heartbeater.cc:643] Failed to heartbeat to 127.21.194.254:46215 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.194.254:46215: connect: Connection refused (error 111)
I20250112 21:02:30.070782 22898 tablet_service.cc:1467] Processing CreateTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d (DEFAULT_TABLE table=default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.071791 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aab6c5a34b4b99ae922d2586a4714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.073436 22627 tablet_service.cc:1467] Processing CreateTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d (DEFAULT_TABLE table=default.Table_f9cc8ce3fae24ce99c2fb46ad561cb41 [id=7bc889b429d44bfe87cd95396f8deadd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.073860 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.074208 22625 tablet_service.cc:1467] Processing CreateTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (DEFAULT_TABLE table=default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.074391 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aab6c5a34b4b99ae922d2586a4714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.073446 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 505606e672b7403b81e9af1d6d954b3f (DEFAULT_TABLE table=default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.074693 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.076046 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.076654 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 505606e672b7403b81e9af1d6d954b3f (DEFAULT_TABLE table=default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.076951 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4e7addcca4efe9698cd08bcec5aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.077033 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (DEFAULT_TABLE table=default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.077229 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.077708 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 505606e672b7403b81e9af1d6d954b3f (DEFAULT_TABLE table=default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.077939 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505606e672b7403b81e9af1d6d954b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.078171 22759 tablet_service.cc:1467] Processing CreateTablet for tablet 76729244dcd340bda0953dc70171dd32 (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.078401 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76729244dcd340bda0953dc70171dd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.079102 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505606e672b7403b81e9af1d6d954b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.080629 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (DEFAULT_TABLE table=default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.080857 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.073529 22624 tablet_service.cc:1467] Processing CreateTablet for tablet 76729244dcd340bda0953dc70171dd32 (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.082594 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 76729244dcd340bda0953dc70171dd32 (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.076046 22762 tablet_service.cc:1467] Processing CreateTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d (DEFAULT_TABLE table=default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.082823 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76729244dcd340bda0953dc70171dd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.082960 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505606e672b7403b81e9af1d6d954b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.083118 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4e7addcca4efe9698cd08bcec5aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.083459 23034 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.084522 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.084725 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e4e7addcca4efe9698cd08bcec5aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.085690 23034 tablet_bootstrap.cc:654] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.086486 23034 log.cc:826] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:30.086977 22624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76729244dcd340bda0953dc70171dd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.087957 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 18ff6bac2d1948bfb207b4a4f9b87eb2
I20250112 21:02:30.088440 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aab6c5a34b4b99ae922d2586a4714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.089020 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:30.089073 22451 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f0aab6c5a34b4b99ae922d2586a4714d consensus state has no leader
I20250112 21:02:30.090494 23034 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.090694 23034 ts_tablet_manager.cc:1397] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20250112 21:02:30.090806 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.091179 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.092590 23036 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.093873 23034 raft_consensus.cc:357] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.094188 23034 raft_consensus.cc:383] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.094286 23034 raft_consensus.cc:738] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.094439 22758 tablet_service.cc:1467] Processing CreateTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
W20250112 21:02:30.094543 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 already in progress: creating tablet
I20250112 21:02:30.094666 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:30.094944 22452 catalog_manager.cc:4839] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 because the tablet was not found. No further retry: Not found: Tablet not found: 18ff6bac2d1948bfb207b4a4f9b87eb2
I20250112 21:02:30.095047 22897 tablet_service.cc:1467] Processing CreateTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.094956 23034 consensus_queue.cc:260] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.095328 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:30.095438 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 already in progress: creating tablet
I20250112 21:02:30.096007 23034 ts_tablet_manager.cc:1428] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250112 21:02:30.096628 22626 tablet_service.cc:1467] Processing CreateTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.096848 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.097437 23037 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.098466 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 76729244dcd340bda0953dc70171dd32 (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.099579 23037 tablet_bootstrap.cc:654] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.099674 23036 tablet_bootstrap.cc:654] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.100149 23034 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.100390 23037 log.cc:826] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:30.100632 23036 log.cc:826] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:30.101231 22828 heartbeater.cc:502] Master 127.21.194.252:40219 was elected leader, sending a full tablet report...
I20250112 21:02:30.102416 23036 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.102591 23036 ts_tablet_manager.cc:1397] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.005s
I20250112 21:02:30.103555 23034 tablet_bootstrap.cc:654] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.104635 22460 master_service.cc:946] ReplaceTablet: received request to replace tablet 76729244dcd340bda0953dc70171dd32 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.105064 23034 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.105218 22459 master_service.cc:946] ReplaceTablet: received request to replace tablet 76729244dcd340bda0953dc70171dd32 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.105285 22464 master_service.cc:946] ReplaceTablet: received request to replace tablet 80e4e7addcca4efe9698cd08bcec5aa8 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.105376 23034 ts_tablet_manager.cc:1397] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:30.105965 23034 raft_consensus.cc:357] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.106091 23034 raft_consensus.cc:383] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.106141 23034 raft_consensus.cc:738] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.106302 23034 consensus_queue.cc:260] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.106223 23036 raft_consensus.cc:357] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.106470 23036 raft_consensus.cc:383] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.106606 23036 raft_consensus.cc:738] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.107313 23036 consensus_queue.cc:260] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.107888 22458 master_service.cc:946] ReplaceTablet: received request to replace tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.108232 23036 ts_tablet_manager.cc:1428] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250112 21:02:30.108495 23037 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.108680 23037 ts_tablet_manager.cc:1397] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
I20250112 21:02:30.109269 22964 heartbeater.cc:502] Master 127.21.194.252:40219 was elected leader, sending a full tablet report...
I20250112 21:02:30.109613 23034 ts_tablet_manager.cc:1428] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:30.110594 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 80e4e7addcca4efe9698cd08bcec5aa8
I20250112 21:02:30.110847 22464 catalog_manager.cc:6596] ReplaceTablet: tablet 80e4e7addcca4efe9698cd08bcec5aa8 deleted and replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d
I20250112 21:02:30.111141 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.111241 23034 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.111644 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.111737 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.111912 23037 raft_consensus.cc:357] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.112076 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 76729244dcd340bda0953dc70171dd32
I20250112 21:02:30.112113 23037 raft_consensus.cc:383] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.112166 23037 raft_consensus.cc:738] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.112323 22460 catalog_manager.cc:6596] ReplaceTablet: tablet 76729244dcd340bda0953dc70171dd32 deleted and replaced by tablet cd94918fa1384a56a246af2afd4a3aff
I20250112 21:02:30.112432 22465 master_service.cc:946] ReplaceTablet: received request to replace tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f from {username='slave'} at 127.0.0.1:39888
W20250112 21:02:30.112594 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 80e4e7addcca4efe9698cd08bcec5aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80e4e7addcca4efe9698cd08bcec5aa8 already in progress: creating tablet
W20250112 21:02:30.112740 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 80e4e7addcca4efe9698cd08bcec5aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80e4e7addcca4efe9698cd08bcec5aa8 already in progress: creating tablet
I20250112 21:02:30.112776 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.112560 23034 tablet_bootstrap.cc:654] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.112972 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.113122 23039 tablet_replica.cc:331] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
W20250112 21:02:30.113303 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 76729244dcd340bda0953dc70171dd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76729244dcd340bda0953dc70171dd32 already in progress: creating tablet
I20250112 21:02:30.113411 23039 raft_consensus.cc:2238] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.113652 23039 raft_consensus.cc:2267] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:30.114405 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 80e4e7addcca4efe9698cd08bcec5aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80e4e7addcca4efe9698cd08bcec5aa8 already in progress: creating tablet
I20250112 21:02:30.114715 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.114742 23039 ts_tablet_manager.cc:1905] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:30.115166 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 76729244dcd340bda0953dc70171dd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76729244dcd340bda0953dc70171dd32 already in progress: creating tablet
I20250112 21:02:30.115514 23036 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.116324 23036 tablet_bootstrap.cc:654] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.117069 23039 ts_tablet_manager.cc:1918] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.117206 23039 log.cc:1198] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/76729244dcd340bda0953dc70171dd32
I20250112 21:02:30.117537 23039 ts_tablet_manager.cc:1939] T 76729244dcd340bda0953dc70171dd32 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.117637 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f
I20250112 21:02:30.117905 22458 catalog_manager.cc:6596] ReplaceTablet: tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f deleted and replaced by tablet f3d96dbf60334b919320321baa001981
I20250112 21:02:30.118206 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.118289 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.118427 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.118450 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:30.118894 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f already in progress: creating tablet
I20250112 21:02:30.118917 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:30.119323 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f already in progress: creating tablet
I20250112 21:02:30.119621 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.119697 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.120121 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 76729244dcd340bda0953dc70171dd32 (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
I20250112 21:02:30.113807 23037 consensus_queue.cc:260] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.121055 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.121084 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.121444 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.121459 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.121802 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.121886 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.122027 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:30.122172 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 76729244dcd340bda0953dc70171dd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76729244dcd340bda0953dc70171dd32 already in progress: creating tablet
W20250112 21:02:30.122316 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 already in progress: creating tablet
W20250112 21:02:30.122437 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 80e4e7addcca4efe9698cd08bcec5aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80e4e7addcca4efe9698cd08bcec5aa8 already in progress: creating tablet
W20250112 21:02:30.122560 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f already in progress: creating tablet
I20250112 21:02:30.123689 23039 tablet_replica.cc:331] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.123800 23039 raft_consensus.cc:2238] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
W20250112 21:02:30.123800 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f already in progress: creating tablet
I20250112 21:02:30.123896 23039 raft_consensus.cc:2267] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.124536 23039 ts_tablet_manager.cc:1905] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.124686 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.125183 23037 ts_tablet_manager.cc:1428] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20250112 21:02:30.125325 22626 tablet_service.cc:1467] Processing CreateTablet for tablet f3d96dbf60334b919320321baa001981 (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.125593 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96dbf60334b919320321baa001981. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.125552 22761 tablet_service.cc:1467] Processing CreateTablet for tablet f3d96dbf60334b919320321baa001981 (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.125794 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96dbf60334b919320321baa001981. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.126288 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.126492 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96801602ee9d4ab7a19e1a46421b5f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.127560 22758 tablet_service.cc:1467] Processing CreateTablet for tablet cd94918fa1384a56a246af2afd4a3aff (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.127740 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd94918fa1384a56a246af2afd4a3aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.128507 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.128715 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96801602ee9d4ab7a19e1a46421b5f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.128881 22898 tablet_service.cc:1467] Processing CreateTablet for tablet cd94918fa1384a56a246af2afd4a3aff (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.128914 22897 tablet_service.cc:1467] Processing CreateTablet for tablet f3d96dbf60334b919320321baa001981 (DEFAULT_TABLE table=default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.129096 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd94918fa1384a56a246af2afd4a3aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.129220 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d96dbf60334b919320321baa001981. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.130390 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d (DEFAULT_TABLE table=default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.130594 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96801602ee9d4ab7a19e1a46421b5f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.132004 23037 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.132923 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.132931 23037 tablet_bootstrap.cc:654] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.133086 23040 tablet_replica.cc:331] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.133452 23040 raft_consensus.cc:2238] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.133585 22626 tablet_service.cc:1467] Processing CreateTablet for tablet cd94918fa1384a56a246af2afd4a3aff (DEFAULT_TABLE table=default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.133703 23040 raft_consensus.cc:2267] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.133790 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd94918fa1384a56a246af2afd4a3aff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.133944 22693 heartbeater.cc:502] Master 127.21.194.252:40219 was elected leader, sending a full tablet report...
I20250112 21:02:30.134757 23037 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.134835 23037 ts_tablet_manager.cc:1397] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.135376 23037 raft_consensus.cc:357] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.135468 23037 raft_consensus.cc:383] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.135452 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.135505 23037 raft_consensus.cc:738] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.135597 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.135612 23037 consensus_queue.cc:260] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.135668 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.135936 23037 ts_tablet_manager.cc:1428] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.136078 23037 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
W20250112 21:02:30.136500 22463 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 96801602ee9d4ab7a19e1a46421b5f0d consensus state has no leader
I20250112 21:02:30.137008 23039 ts_tablet_manager.cc:1918] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.137002 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.137070 23039 log.cc:1198] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/18ff6bac2d1948bfb207b4a4f9b87eb2
I20250112 21:02:30.137267 23039 ts_tablet_manager.cc:1939] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.137919 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.138033 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.138247 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (table default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]) successfully deleted
W20250112 21:02:30.138396 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 76729244dcd340bda0953dc70171dd32 because the tablet was not found. No further retry: Not found: Tablet not found: 76729244dcd340bda0953dc70171dd32
W20250112 21:02:30.138541 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 80e4e7addcca4efe9698cd08bcec5aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80e4e7addcca4efe9698cd08bcec5aa8 already in progress: creating tablet
I20250112 21:02:30.138964 23037 tablet_bootstrap.cc:654] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.139904 23034 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.139990 23034 ts_tablet_manager.cc:1397] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20250112 21:02:30.140094 23036 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.140201 23036 ts_tablet_manager.cc:1397] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.001s
I20250112 21:02:30.140340 23040 ts_tablet_manager.cc:1905] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.140467 23034 raft_consensus.cc:357] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.140568 23034 raft_consensus.cc:383] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.140604 23034 raft_consensus.cc:738] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.140719 23034 consensus_queue.cc:260] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.140769 23036 raft_consensus.cc:357] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.140867 23036 raft_consensus.cc:383] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.140898 23036 raft_consensus.cc:738] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.140991 23034 ts_tablet_manager.cc:1428] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.141036 23036 consensus_queue.cc:260] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.141134 23034 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.142112 23034 tablet_bootstrap.cc:654] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.142324 23040 ts_tablet_manager.cc:1918] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.142391 23040 log.cc:1198] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/80e4e7addcca4efe9698cd08bcec5aa8
I20250112 21:02:30.142619 23040 ts_tablet_manager.cc:1939] T 80e4e7addcca4efe9698cd08bcec5aa8 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.142732 23036 ts_tablet_manager.cc:1428] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.142882 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.142921 23036 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.143692 23040 tablet_replica.cc:331] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.143777 23040 raft_consensus.cc:2238] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.143826 23036 tablet_bootstrap.cc:654] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.143805 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 80e4e7addcca4efe9698cd08bcec5aa8 (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.143859 23040 raft_consensus.cc:2267] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:30.143952 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 already in progress: creating tablet
I20250112 21:02:30.144268 23037 tablet_bootstrap.cc:492] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.144331 23037 ts_tablet_manager.cc:1397] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250112 21:02:30.144747 23037 raft_consensus.cc:357] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.144855 23036 tablet_bootstrap.cc:492] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.144868 23037 raft_consensus.cc:383] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.144933 23036 ts_tablet_manager.cc:1397] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20250112 21:02:30.144933 23037 raft_consensus.cc:738] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.145094 23037 consensus_queue.cc:260] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.145341 23036 raft_consensus.cc:357] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.145395 23037 ts_tablet_manager.cc:1428] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.145439 23036 raft_consensus.cc:383] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.145473 23036 raft_consensus.cc:738] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.145607 23036 consensus_queue.cc:260] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.145846 23036 ts_tablet_manager.cc:1428] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.145993 23036 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.146970 23036 tablet_bootstrap.cc:654] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.147315 23037 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.147760 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.147926 23038 tablet_replica.cc:331] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.148120 23034 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.148190 23034 ts_tablet_manager.cc:1397] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250112 21:02:30.148226 23038 raft_consensus.cc:2238] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.148439 23037 tablet_bootstrap.cc:654] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.148519 23038 raft_consensus.cc:2267] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.148645 23034 raft_consensus.cc:357] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.148733 23034 raft_consensus.cc:383] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.148763 23034 raft_consensus.cc:738] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.148872 23034 consensus_queue.cc:260] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.149101 23034 ts_tablet_manager.cc:1428] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.149138 23040 ts_tablet_manager.cc:1905] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.149267 23034 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.150169 23034 tablet_bootstrap.cc:654] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.150329 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.151101 23040 ts_tablet_manager.cc:1918] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.151145 23040 log.cc:1198] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/76729244dcd340bda0953dc70171dd32
I20250112 21:02:30.151268 23040 ts_tablet_manager.cc:1939] T 76729244dcd340bda0953dc70171dd32 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.152005 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet 76729244dcd340bda0953dc70171dd32 with delete_type TABLET_DATA_DELETED (replaced by tablet cd94918fa1384a56a246af2afd4a3aff) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.152179 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.152295 23034 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.152376 23034 ts_tablet_manager.cc:1397] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.152379 23037 tablet_bootstrap.cc:492] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.152480 23037 ts_tablet_manager.cc:1397] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:30.152540 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 76729244dcd340bda0953dc70171dd32 (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
W20250112 21:02:30.152693 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f already in progress: creating tablet
I20250112 21:02:30.152830 23034 raft_consensus.cc:357] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.152854 23037 raft_consensus.cc:357] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.152918 23034 raft_consensus.cc:383] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.152932 23037 raft_consensus.cc:383] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.152946 23034 raft_consensus.cc:738] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.152962 23037 raft_consensus.cc:738] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.153059 23037 consensus_queue.cc:260] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.153059 23034 consensus_queue.cc:260] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.153281 23037 ts_tablet_manager.cc:1428] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.153295 23034 ts_tablet_manager.cc:1428] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.153426 23037 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.153426 23034 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.154279 23034 tablet_bootstrap.cc:654] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.154335 23037 tablet_bootstrap.cc:654] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.154330 23036 tablet_bootstrap.cc:492] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.154459 23036 ts_tablet_manager.cc:1397] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20250112 21:02:30.154726 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.154920 23036 raft_consensus.cc:357] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.155011 23036 raft_consensus.cc:383] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.155040 23036 raft_consensus.cc:738] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.155169 23036 consensus_queue.cc:260] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.155656 23040 tablet_replica.cc:331] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.155745 23040 raft_consensus.cc:2238] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.155820 23040 raft_consensus.cc:2267] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.156001 23036 ts_tablet_manager.cc:1428] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.156167 23036 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.156258 23040 ts_tablet_manager.cc:1905] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.157078 23036 tablet_bootstrap.cc:654] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.157922 23040 ts_tablet_manager.cc:1918] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.157965 23040 log.cc:1198] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/18ff6bac2d1948bfb207b4a4f9b87eb2
I20250112 21:02:30.158010 23036 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.158074 23036 ts_tablet_manager.cc:1397] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.158084 23040 ts_tablet_manager.cc:1939] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.158454 23036 raft_consensus.cc:357] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.158556 23036 raft_consensus.cc:383] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.158586 23036 raft_consensus.cc:738] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.158601 23038 ts_tablet_manager.cc:1905] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.158715 23036 consensus_queue.cc:260] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.158795 23037 tablet_bootstrap.cc:492] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.158856 23037 ts_tablet_manager.cc:1397] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:30.159235 23037 raft_consensus.cc:357] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.159323 23037 raft_consensus.cc:383] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.159353 23037 raft_consensus.cc:738] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.159451 23037 consensus_queue.cc:260] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.159688 23037 ts_tablet_manager.cc:1428] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.159826 23037 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.160708 23037 tablet_bootstrap.cc:654] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.160780 23038 ts_tablet_manager.cc:1918] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.160823 23036 ts_tablet_manager.cc:1428] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.161000 23036 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.161824 23036 tablet_bootstrap.cc:654] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.162143 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (table default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]) successfully deleted
I20250112 21:02:30.162693 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.163498 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.163658 23039 tablet_replica.cc:331] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.163744 23039 raft_consensus.cc:2238] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.163825 23039 raft_consensus.cc:2267] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.164191 23034 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.164203 23039 ts_tablet_manager.cc:1905] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.164290 23034 ts_tablet_manager.cc:1397] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250112 21:02:30.164748 23034 raft_consensus.cc:357] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.164855 23034 raft_consensus.cc:383] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.164891 23034 raft_consensus.cc:738] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.164995 23034 consensus_queue.cc:260] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.165249 23034 ts_tablet_manager.cc:1428] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.165402 23034 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.165974 23039 ts_tablet_manager.cc:1918] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.166038 23039 log.cc:1198] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/80e4e7addcca4efe9698cd08bcec5aa8
I20250112 21:02:30.166210 23039 ts_tablet_manager.cc:1939] T 80e4e7addcca4efe9698cd08bcec5aa8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.166424 23034 tablet_bootstrap.cc:654] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.166842 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 80e4e7addcca4efe9698cd08bcec5aa8 (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.166873 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet 80e4e7addcca4efe9698cd08bcec5aa8 with delete_type TABLET_DATA_DELETED (replaced by tablet 96801602ee9d4ab7a19e1a46421b5f0d) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.167438 23034 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.167510 23034 ts_tablet_manager.cc:1397] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.167831 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.167891 23034 raft_consensus.cc:357] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.167974 23034 raft_consensus.cc:383] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.168006 23034 raft_consensus.cc:738] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.168097 23039 tablet_replica.cc:331] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.168087 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.168116 23034 consensus_queue.cc:260] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.168193 23039 raft_consensus.cc:2238] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.168368 23039 raft_consensus.cc:2267] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.168365 23034 ts_tablet_manager.cc:1428] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.168705 23034 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.169519 23034 tablet_bootstrap.cc:654] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.169757 23038 log.cc:1198] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/18ff6bac2d1948bfb207b4a4f9b87eb2
I20250112 21:02:30.170054 23038 ts_tablet_manager.cc:1939] T 18ff6bac2d1948bfb207b4a4f9b87eb2 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.170277 23039 ts_tablet_manager.cc:1905] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.171303 23038 tablet_replica.cc:331] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.171417 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 18ff6bac2d1948bfb207b4a4f9b87eb2 (table default.Table_6be0636837894cf080f67f077d712ded [id=01b5786b24ad48028ada9a9bb48aa6b5]) successfully deleted
I20250112 21:02:30.171468 23038 raft_consensus.cc:2238] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.171624 23038 raft_consensus.cc:2267] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.171893 23039 ts_tablet_manager.cc:1918] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.171949 23039 log.cc:1198] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/fc0ba77d301c4bd9bf0d2bf1f1cc375f
I20250112 21:02:30.172053 23038 ts_tablet_manager.cc:1905] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.172094 23039 ts_tablet_manager.cc:1939] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.172912 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.172981 23037 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.173055 23037 ts_tablet_manager.cc:1397] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250112 21:02:30.173103 23034 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.173172 23034 ts_tablet_manager.cc:1397] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:30.173419 23037 raft_consensus.cc:357] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.173506 23037 raft_consensus.cc:383] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.173527 23037 raft_consensus.cc:738] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.173564 23034 raft_consensus.cc:357] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.173652 23034 raft_consensus.cc:383] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.173627 23037 consensus_queue.cc:260] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.173684 23034 raft_consensus.cc:738] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.173841 23038 ts_tablet_manager.cc:1918] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.173848 23037 ts_tablet_manager.cc:1428] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.173827 23034 consensus_queue.cc:260] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.173894 23038 log.cc:1198] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/76729244dcd340bda0953dc70171dd32
I20250112 21:02:30.173975 23037 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.174067 23038 ts_tablet_manager.cc:1939] T 76729244dcd340bda0953dc70171dd32 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.174063 23034 ts_tablet_manager.cc:1428] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.174840 23037 tablet_bootstrap.cc:654] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.174958 23034 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.175055 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.175482 23041 raft_consensus.cc:491] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.175617 23041 raft_consensus.cc:513] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.175838 23034 tablet_bootstrap.cc:654] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.176712 23036 tablet_bootstrap.cc:492] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.176798 23036 ts_tablet_manager.cc:1397] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250112 21:02:30.176806 23041 leader_election.cc:290] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.177178 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.177238 23036 raft_consensus.cc:357] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.177327 23036 raft_consensus.cc:383] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.177356 23036 raft_consensus.cc:738] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.177408 23040 tablet_replica.cc:331] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.177462 23036 consensus_queue.cc:260] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.177506 23040 raft_consensus.cc:2238] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.177603 23040 raft_consensus.cc:2267] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.177718 23036 ts_tablet_manager.cc:1428] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.177874 23036 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.177951 23040 ts_tablet_manager.cc:1905] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.178777 23036 tablet_bootstrap.cc:654] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.179108 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.179872 23040 ts_tablet_manager.cc:1918] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.179932 23040 log.cc:1198] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/fc0ba77d301c4bd9bf0d2bf1f1cc375f
I20250112 21:02:30.180099 23040 ts_tablet_manager.cc:1939] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.180692 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f with delete_type TABLET_DATA_DELETED (replaced by tablet f3d96dbf60334b919320321baa001981) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.180886 23038 tablet_replica.cc:331] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.180979 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 76729244dcd340bda0953dc70171dd32 (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
I20250112 21:02:30.181077 23038 raft_consensus.cc:2238] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.181201 23038 raft_consensus.cc:2267] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.181577 23038 ts_tablet_manager.cc:1905] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.182169 23034 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.182252 23034 ts_tablet_manager.cc:1397] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:30.182687 23034 raft_consensus.cc:357] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.182773 23034 raft_consensus.cc:383] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.182798 23034 raft_consensus.cc:738] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.182904 23034 consensus_queue.cc:260] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.182911 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.183142 23034 ts_tablet_manager.cc:1428] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.184029 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
W20250112 21:02:30.184293 22463 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cd94918fa1384a56a246af2afd4a3aff consensus state has no leader
I20250112 21:02:30.184899 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aab6c5a34b4b99ae922d2586a4714d" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.185137 22647 raft_consensus.cc:2463] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.185568 22715 leader_election.cc:304] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.185717 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.186051 23038 ts_tablet_manager.cc:1918] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.186338 23038 log.cc:1198] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/80e4e7addcca4efe9698cd08bcec5aa8
I20250112 21:02:30.186607 23038 ts_tablet_manager.cc:1939] T 80e4e7addcca4efe9698cd08bcec5aa8 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.186839 23041 raft_consensus.cc:2798] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.186926 23041 raft_consensus.cc:491] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.186983 23041 raft_consensus.cc:3054] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.187275 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 80e4e7addcca4efe9698cd08bcec5aa8 (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.187312 23038 tablet_replica.cc:331] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.187409 23038 raft_consensus.cc:2238] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.187520 23038 raft_consensus.cc:2267] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.187927 23038 ts_tablet_manager.cc:1905] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.187985 23041 raft_consensus.cc:513] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.188329 23041 leader_election.cc:290] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.188637 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aab6c5a34b4b99ae922d2586a4714d" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.188737 22647 raft_consensus.cc:3054] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.189503 23038 ts_tablet_manager.cc:1918] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.189561 23038 log.cc:1198] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/fc0ba77d301c4bd9bf0d2bf1f1cc375f
I20250112 21:02:30.189745 23038 ts_tablet_manager.cc:1939] T fc0ba77d301c4bd9bf0d2bf1f1cc375f P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.190102 22647 raft_consensus.cc:2463] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.190263 23037 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.190336 23037 ts_tablet_manager.cc:1397] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250112 21:02:30.190320 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet fc0ba77d301c4bd9bf0d2bf1f1cc375f (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.190392 22715 leader_election.cc:304] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.190560 23041 raft_consensus.cc:2798] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.190708 23041 raft_consensus.cc:695] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.190760 23036 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.190830 23036 ts_tablet_manager.cc:1397] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20250112 21:02:30.190824 23037 raft_consensus.cc:357] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.190928 23037 raft_consensus.cc:383] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.190973 23037 raft_consensus.cc:738] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.191093 23037 consensus_queue.cc:260] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.191246 23036 raft_consensus.cc:357] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.191256 23041 consensus_queue.cc:237] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.191383 23037 ts_tablet_manager.cc:1428] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.191260 22918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aab6c5a34b4b99ae922d2586a4714d" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.191577 23037 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.191578 22918 raft_consensus.cc:2463] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.191340 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aab6c5a34b4b99ae922d2586a4714d" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.191840 22917 raft_consensus.cc:3054] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.192553 23037 tablet_bootstrap.cc:654] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.192950 22917 raft_consensus.cc:2463] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.193714 23037 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.193794 23037 ts_tablet_manager.cc:1397] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20250112 21:02:30.194149 23037 raft_consensus.cc:357] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.194233 23037 raft_consensus.cc:383] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.194262 23037 raft_consensus.cc:738] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.194351 23037 consensus_queue.cc:260] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.191356 23036 raft_consensus.cc:383] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.194571 23036 raft_consensus.cc:738] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.194582 23037 ts_tablet_manager.cc:1428] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.194715 23037 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.194684 23036 consensus_queue.cc:260] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.195430 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.195701 23037 tablet_bootstrap.cc:654] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.196704 23036 ts_tablet_manager.cc:1428] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20250112 21:02:30.196849 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.197546 22462 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.198107 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.198267 23036 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.199314 23036 tablet_bootstrap.cc:654] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.199615 22463 catalog_manager.cc:5526] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.200129 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.200754 23036 tablet_bootstrap.cc:492] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.200829 23036 ts_tablet_manager.cc:1397] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250112 21:02:30.200850 23037 tablet_bootstrap.cc:492] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.200933 23037 ts_tablet_manager.cc:1397] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:30.201176 23036 raft_consensus.cc:357] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.201277 23036 raft_consensus.cc:383] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.201308 23036 raft_consensus.cc:738] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.201326 23037 raft_consensus.cc:357] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.201442 23037 raft_consensus.cc:383] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.201412 23036 consensus_queue.cc:260] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.201478 23037 raft_consensus.cc:738] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.201579 23037 consensus_queue.cc:260] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.201632 23036 ts_tablet_manager.cc:1428] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.201834 23037 ts_tablet_manager.cc:1428] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.202865 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.204135 23036 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.204281 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_b578d56d989e4975bf70943e78b9b84e [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 1 got 0
I20250112 21:02:30.205076 23036 tablet_bootstrap.cc:654] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.205947 23036 tablet_bootstrap.cc:492] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.206023 23036 ts_tablet_manager.cc:1397] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.206662 23036 raft_consensus.cc:357] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.206775 23036 raft_consensus.cc:383] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.206807 23036 raft_consensus.cc:738] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.206908 23036 consensus_queue.cc:260] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.207159 23036 ts_tablet_manager.cc:1428] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.208164 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_badce8415eba41c2a5f23fc78f823476 [id=2684b8498cea414a98b4471486f74b6d]). Expected version 1 got 0
I20250112 21:02:30.211360 23065 raft_consensus.cc:491] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.211467 23065 raft_consensus.cc:513] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.211808 23065 leader_election.cc:290] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
W20250112 21:02:30.211927 22696 tablet.cc:2367] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250112 21:02:30.212133 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505606e672b7403b81e9af1d6d954b3f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.212250 22647 raft_consensus.cc:2463] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.212639 22715 leader_election.cc:304] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.212819 23065 raft_consensus.cc:2798] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.212834 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505606e672b7403b81e9af1d6d954b3f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.212889 23065 raft_consensus.cc:491] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.212925 23065 raft_consensus.cc:3054] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.212936 22917 raft_consensus.cc:2463] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.213770 23065 raft_consensus.cc:513] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.214035 23065 leader_election.cc:290] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.214296 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505606e672b7403b81e9af1d6d954b3f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.214351 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505606e672b7403b81e9af1d6d954b3f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.214430 22647 raft_consensus.cc:3054] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.214454 22917 raft_consensus.cc:3054] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.215169 22917 raft_consensus.cc:2463] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.215462 22647 raft_consensus.cc:2463] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.215557 22717 leader_election.cc:304] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.215723 23065 raft_consensus.cc:2798] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.215824 23065 raft_consensus.cc:695] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.215958 23065 consensus_queue.cc:237] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.217732 22458 catalog_manager.cc:5526] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.217962 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_164ef4de2e7b46f28bea058a95e8afb8 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 1 got 0
I20250112 21:02:30.224635 22917 raft_consensus.cc:1270] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.224635 22647 raft_consensus.cc:1270] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.225251 23041 consensus_queue.cc:1035] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.225450 23065 consensus_queue.cc:1035] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.229110 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.229869 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.232328 23081 tablet.cc:1721] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.233265 23083 tablet.cc:1721] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.234853 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.239121 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]). Expected version 1 got 0
I20250112 21:02:30.239547 22463 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd] alter complete (version 1)
I20250112 21:02:30.239624 23076 mvcc.cc:204] Tried to move back new op lower bound from 7113587712914685952 to 7113587712795963392. Current Snapshot: MvccSnapshot[applied={T|T < 7113587712914685952}]
I20250112 21:02:30.239858 23084 tablet.cc:1721] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.247975 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c4d60ba7e58a4665ad787d100878f513"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.248327 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4d60ba7e58a4665ad787d100878f513 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.249471 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_4e1c3b3ac08c48c686f2ccda45049e08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.249621 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_9aedf334cda8457abe817ed20475d648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.249805 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e1c3b3ac08c48c686f2ccda45049e08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.249887 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9aedf334cda8457abe817ed20475d648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.253314 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_a2b0ee75b38b434fb420b9a519603971"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.253688 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2b0ee75b38b434fb420b9a519603971 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.254719 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_6b1bc98f952545e3a3f8bf654b07976c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.254791 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_dca486ee48eb4525b18f1b2cf11a5d6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.254858 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f185eebd950d478c944225d297d83128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.255021 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b1bc98f952545e3a3f8bf654b07976c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.255062 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dca486ee48eb4525b18f1b2cf11a5d6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.255100 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f185eebd950d478c944225d297d83128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.255947 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_a200ec004be44c6eacd33f76133ab58e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.256218 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a200ec004be44c6eacd33f76133ab58e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.256304 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.256587 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.258610 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_b578d56d989e4975bf70943e78b9b84e" } new_table_name: "default.Table_275d8cd15cd3478cbf8afb8efbdcee9d" modify_external_catalogs: true
I20250112 21:02:30.259543 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_badce8415eba41c2a5f23fc78f823476" } new_table_name: "default.Table_53c56a74430245e5a2f5fdf757849d0d" modify_external_catalogs: true
I20250112 21:02:30.260941 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (DEFAULT_TABLE table=default.Table_c4d60ba7e58a4665ad787d100878f513 [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.261253 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f19de7823b40c1ba7ed03d2d8adfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.261947 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (DEFAULT_TABLE table=default.Table_c4d60ba7e58a4665ad787d100878f513 [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.262107 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (DEFAULT_TABLE table=default.Table_c4d60ba7e58a4665ad787d100878f513 [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.262214 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f19de7823b40c1ba7ed03d2d8adfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.262343 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f19de7823b40c1ba7ed03d2d8adfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.263136 23036 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.264132 23036 tablet_bootstrap.cc:654] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.264220 23037 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.264220 23034 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.265185 23037 tablet_bootstrap.cc:654] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.265401 23034 tablet_bootstrap.cc:654] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.265755 23036 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.265830 23036 ts_tablet_manager.cc:1397] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.266269 23037 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.266294 23036 raft_consensus.cc:357] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.266363 23037 ts_tablet_manager.cc:1397] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.266394 23036 raft_consensus.cc:383] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.266425 23036 raft_consensus.cc:738] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.266515 23034 tablet_bootstrap.cc:492] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.266597 23034 ts_tablet_manager.cc:1397] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.266564 23036 consensus_queue.cc:260] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.266834 23036 ts_tablet_manager.cc:1428] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.266790 23037 raft_consensus.cc:357] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.266885 23037 raft_consensus.cc:383] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.266913 23037 raft_consensus.cc:738] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.266983 23034 raft_consensus.cc:357] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.267030 23037 consensus_queue.cc:260] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.267072 23034 raft_consensus.cc:383] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.267109 23034 raft_consensus.cc:738] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.267221 23034 consensus_queue.cc:260] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.267283 23037 ts_tablet_manager.cc:1428] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.267496 23034 ts_tablet_manager.cc:1428] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.268538 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_164ef4de2e7b46f28bea058a95e8afb8" } new_table_name: "default.Table_cc2500d1fd764e0287ac184ef9039be4" modify_external_catalogs: true
I20250112 21:02:30.268648 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_41b6d08b98ad4f95bb9fcfac9d47c313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.268983 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.271068 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d3fc8154d5774a0b96e21a98b2167cd5" } modify_external_catalogs: true
I20250112 21:02:30.271162 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d3fc8154d5774a0b96e21a98b2167cd5" } modify_external_catalogs: true
I20250112 21:02:30.275671 22464 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c4d60ba7e58a4665ad787d100878f513" } new_table_name: "default.Table_050e64efa6ef46c1a9e5d89b3b7adf83" modify_external_catalogs: true
I20250112 21:02:30.275856 22463 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_30902205854d4cd6b5d2a449ac5a0e93" } modify_external_catalogs: true
I20250112 21:02:30.275946 22463 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_30902205854d4cd6b5d2a449ac5a0e93" } modify_external_catalogs: true
I20250112 21:02:30.277020 22894 tablet_service.cc:1467] Processing CreateTablet for tablet e18b928a80ae4d3b906ac04855357f2c (DEFAULT_TABLE table=default.Table_4e1c3b3ac08c48c686f2ccda45049e08 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.277091 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e (DEFAULT_TABLE table=default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.277283 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18b928a80ae4d3b906ac04855357f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.277349 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd8f02ab7724035a17ee0b0ceacd28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.279224 23034 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.279651 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e (DEFAULT_TABLE table=default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.279809 22626 tablet_service.cc:1467] Processing CreateTablet for tablet e18b928a80ae4d3b906ac04855357f2c (DEFAULT_TABLE table=default.Table_4e1c3b3ac08c48c686f2ccda45049e08 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.279889 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd8f02ab7724035a17ee0b0ceacd28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.280033 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18b928a80ae4d3b906ac04855357f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.280359 23034 tablet_bootstrap.cc:654] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.281767 23037 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.281809 23036 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.281951 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e (DEFAULT_TABLE table=default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.282166 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd8f02ab7724035a17ee0b0ceacd28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.282730 23036 tablet_bootstrap.cc:654] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.282730 23037 tablet_bootstrap.cc:654] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.283486 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_4e1c3b3ac08c48c686f2ccda45049e08" } new_table_name: "default.Table_6cfb064087fd4bd8b7ede81666c1fdbe" modify_external_catalogs: true
I20250112 21:02:30.284395 23036 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
W20250112 21:02:30.284392 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96801602ee9d4ab7a19e1a46421b5f0d consensus state has no leader
I20250112 21:02:30.284509 23036 ts_tablet_manager.cc:1397] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.284581 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_9aedf334cda8457abe817ed20475d648" } modify_external_catalogs: true
I20250112 21:02:30.284597 22466 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_dca486ee48eb4525b18f1b2cf11a5d6e" } modify_external_catalogs: true
I20250112 21:02:30.284696 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_9aedf334cda8457abe817ed20475d648" } modify_external_catalogs: true
I20250112 21:02:30.284729 22466 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_dca486ee48eb4525b18f1b2cf11a5d6e" } modify_external_catalogs: true
I20250112 21:02:30.284902 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet f0aab6c5a34b4b99ae922d2586a4714d
I20250112 21:02:30.284983 23036 raft_consensus.cc:357] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.285073 23036 raft_consensus.cc:383] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.285102 23036 raft_consensus.cc:738] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.285226 23036 consensus_queue.cc:260] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.285481 23036 ts_tablet_manager.cc:1428] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.285641 23036 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.285725 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.285876 23040 tablet_replica.cc:331] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.285981 23040 raft_consensus.cc:2238] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.286132 23040 raft_consensus.cc:2267] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.286569 22647 raft_consensus.cc:1270] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.286556 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.286636 22917 raft_consensus.cc:1270] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.286664 23036 tablet_bootstrap.cc:654] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.286720 23039 tablet_replica.cc:331] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.286827 23039 raft_consensus.cc:2238] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.286937 23082 consensus_queue.cc:1035] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.287103 23039 raft_consensus.cc:2267] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.287722 23082 consensus_queue.cc:1035] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.287822 23039 ts_tablet_manager.cc:1905] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.288611 22758 tablet_service.cc:1467] Processing CreateTablet for tablet e18b928a80ae4d3b906ac04855357f2c (DEFAULT_TABLE table=default.Table_4e1c3b3ac08c48c686f2ccda45049e08 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.288842 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18b928a80ae4d3b906ac04855357f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.289921 23039 ts_tablet_manager.cc:1918] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.289983 23039 log.cc:1198] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/f0aab6c5a34b4b99ae922d2586a4714d
I20250112 21:02:30.290215 23039 ts_tablet_manager.cc:1939] T f0aab6c5a34b4b99ae922d2586a4714d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.290248 23040 ts_tablet_manager.cc:1905] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.290959 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]) successfully deleted
W20250112 21:02:30.291100 22462 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd94918fa1384a56a246af2afd4a3aff consensus state has no leader
I20250112 21:02:30.292680 23040 ts_tablet_manager.cc:1918] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.292757 23040 log.cc:1198] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/f0aab6c5a34b4b99ae922d2586a4714d
I20250112 21:02:30.292976 23040 ts_tablet_manager.cc:1939] T f0aab6c5a34b4b99ae922d2586a4714d P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.292963 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aab6c5a34b4b99ae922d2586a4714d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.293126 23038 tablet_replica.cc:331] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.293246 23038 raft_consensus.cc:2238] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.293404 23038 raft_consensus.cc:2267] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.293406 22462 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_a2b0ee75b38b434fb420b9a519603971" } modify_external_catalogs: true
I20250112 21:02:30.293517 22462 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_a2b0ee75b38b434fb420b9a519603971" } modify_external_catalogs: true
I20250112 21:02:30.293640 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]) successfully deleted
I20250112 21:02:30.294063 23036 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.294147 23036 ts_tablet_manager.cc:1397] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250112 21:02:30.294359 23038 ts_tablet_manager.cc:1905] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.294574 23036 raft_consensus.cc:357] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.294667 23036 raft_consensus.cc:383] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.294697 23036 raft_consensus.cc:738] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.294800 23036 consensus_queue.cc:260] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.295027 23036 ts_tablet_manager.cc:1428] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.295590 22463 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet f3d96dbf60334b919320321baa001981
I20250112 21:02:30.296319 23038 ts_tablet_manager.cc:1918] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.296382 23038 log.cc:1198] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/f0aab6c5a34b4b99ae922d2586a4714d
I20250112 21:02:30.296502 23037 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.296566 23037 ts_tablet_manager.cc:1397] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250112 21:02:30.296656 23038 ts_tablet_manager.cc:1939] T f0aab6c5a34b4b99ae922d2586a4714d P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.296906 23037 raft_consensus.cc:357] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.296988 23037 raft_consensus.cc:383] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.297017 23037 raft_consensus.cc:738] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.297143 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d96dbf60334b919320321baa001981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.297123 23037 consensus_queue.cc:260] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.297286 23040 tablet_replica.cc:331] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.297381 23037 ts_tablet_manager.cc:1428] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.297523 23037 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.297541 23040 raft_consensus.cc:2238] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.297624 23040 raft_consensus.cc:2267] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.297977 23040 ts_tablet_manager.cc:1905] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.298025 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d96dbf60334b919320321baa001981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.298719 23037 tablet_bootstrap.cc:654] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.299615 23037 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.299685 23037 ts_tablet_manager.cc:1397] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.299723 23040 ts_tablet_manager.cc:1918] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.299775 23040 log.cc:1198] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/f3d96dbf60334b919320321baa001981
W20250112 21:02:30.299824 22457 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e18b928a80ae4d3b906ac04855357f2c consensus state has no leader
I20250112 21:02:30.299947 23040 ts_tablet_manager.cc:1939] T f3d96dbf60334b919320321baa001981 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.300082 23037 raft_consensus.cc:357] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.300225 23037 raft_consensus.cc:383] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.300258 23037 raft_consensus.cc:738] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.300350 23037 consensus_queue.cc:260] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.300616 23037 ts_tablet_manager.cc:1428] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250112 21:02:30.301280 22967 tablet.cc:2367] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250112 21:02:30.302006 23034 tablet_bootstrap.cc:492] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.302090 23034 ts_tablet_manager.cc:1397] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20250112 21:02:30.302546 23034 raft_consensus.cc:357] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.302644 23034 raft_consensus.cc:383] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.302676 23034 raft_consensus.cc:738] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.302785 23034 consensus_queue.cc:260] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.302882 23081 tablet.cc:1721] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.303022 23034 ts_tablet_manager.cc:1428] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.303169 23034 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.304095 23034 tablet_bootstrap.cc:654] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.305100 23083 tablet.cc:1721] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.307396 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet f3d96dbf60334b919320321baa001981 (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.307983 23081 tablet.cc:1716] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Skipping requested alter to schema version 2, tablet already version 2
I20250112 21:02:30.308065 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet f3d96dbf60334b919320321baa001981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.308152 23083 tablet.cc:1716] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Skipping requested alter to schema version 2, tablet already version 2
I20250112 21:02:30.309219 23038 tablet_replica.cc:331] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.309335 23038 raft_consensus.cc:2238] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.309305 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet f0aab6c5a34b4b99ae922d2586a4714d (table default.Table_d3fc8154d5774a0b96e21a98b2167cd5 [id=7bc889b429d44bfe87cd95396f8deadd]) successfully deleted
I20250112 21:02:30.309427 23038 raft_consensus.cc:2267] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.309583 23039 tablet_replica.cc:331] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.309701 23039 raft_consensus.cc:2238] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.309785 23039 raft_consensus.cc:2267] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.309806 23038 ts_tablet_manager.cc:1905] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.310246 23039 ts_tablet_manager.cc:1905] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.311340 23038 ts_tablet_manager.cc:1918] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.311398 23038 log.cc:1198] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/f3d96dbf60334b919320321baa001981
I20250112 21:02:30.311561 23038 ts_tablet_manager.cc:1939] T f3d96dbf60334b919320321baa001981 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.311758 23039 ts_tablet_manager.cc:1918] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.311818 23039 log.cc:1198] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/f3d96dbf60334b919320321baa001981
I20250112 21:02:30.311978 23039 ts_tablet_manager.cc:1939] T f3d96dbf60334b919320321baa001981 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.312319 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet f3d96dbf60334b919320321baa001981 (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.312734 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet f3d96dbf60334b919320321baa001981 (table default.Table_30902205854d4cd6b5d2a449ac5a0e93 [id=2fcd62ed28b04b62a6e2320c93c960c1]) successfully deleted
I20250112 21:02:30.313931 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet 4cd8f02ab7724035a17ee0b0ceacd28e from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.314431 23034 tablet_bootstrap.cc:492] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.314508 23034 ts_tablet_manager.cc:1397] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250112 21:02:30.314925 23034 raft_consensus.cc:357] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.315019 23034 raft_consensus.cc:383] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.315050 23034 raft_consensus.cc:738] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.315160 23034 consensus_queue.cc:260] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.315414 23034 ts_tablet_manager.cc:1428] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.315670 23078 mvcc.cc:204] Tried to move back new op lower bound from 7113587713169960960 to 7113587712885665792. Current Snapshot: MvccSnapshot[applied={T|T < 7113587713169960960}]
I20250112 21:02:30.316475 23084 tablet.cc:1721] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250112 21:02:30.318694 22464 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11f19de7823b40c1ba7ed03d2d8adfcd consensus state has no leader
I20250112 21:02:30.321054 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 (DEFAULT_TABLE table=default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.321216 22758 tablet_service.cc:1467] Processing CreateTablet for tablet c0d105c1051c477f839d0d60304cf92f (DEFAULT_TABLE table=default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.321282 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ab4d56670242c7ac1cfb180eabf3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.321400 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d105c1051c477f839d0d60304cf92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.321660 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.321861 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fda611fd0a4b3d91001ab926f74df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.323324 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 833b963c15c94c40b685b841defeec4f (DEFAULT_TABLE table=default.Table_f185eebd950d478c944225d297d83128 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.323561 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet c0d105c1051c477f839d0d60304cf92f
I20250112 21:02:30.323609 22759 tablet_service.cc:1467] Processing CreateTablet for tablet e021c943e72d4db4b43e524f53553425 (DEFAULT_TABLE table=default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.323969 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 75009f9e6889456da2792ebe20712b7b (DEFAULT_TABLE table=default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.325151 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c943e72d4db4b43e524f53553425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.325340 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e18b928a80ae4d3b906ac04855357f2c (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
I20250112 21:02:30.326067 22893 tablet_service.cc:1467] Processing CreateTablet for tablet 75009f9e6889456da2792ebe20712b7b (DEFAULT_TABLE table=default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.326215 22897 tablet_service.cc:1467] Processing CreateTablet for tablet c0d105c1051c477f839d0d60304cf92f (DEFAULT_TABLE table=default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.326304 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e18b928a80ae4d3b906ac04855357f2c (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
I20250112 21:02:30.326354 22893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75009f9e6889456da2792ebe20712b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.326566 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 833b963c15c94c40b685b841defeec4f (DEFAULT_TABLE table=default.Table_f185eebd950d478c944225d297d83128 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.326761 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833b963c15c94c40b685b841defeec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.326913 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833b963c15c94c40b685b841defeec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.328274 23036 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.328323 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.326074 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 (DEFAULT_TABLE table=default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.328640 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75009f9e6889456da2792ebe20712b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.328600 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.328930 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet e18b928a80ae4d3b906ac04855357f2c from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.328948 22896 tablet_service.cc:1467] Processing CreateTablet for tablet e021c943e72d4db4b43e524f53553425 (DEFAULT_TABLE table=default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.328612 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ab4d56670242c7ac1cfb180eabf3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.329257 23036 tablet_bootstrap.cc:654] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.329789 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet 4cd8f02ab7724035a17ee0b0ceacd28e from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.330641 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.330906 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d105c1051c477f839d0d60304cf92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.331306 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 (DEFAULT_TABLE table=default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.331547 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38ab4d56670242c7ac1cfb180eabf3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.332587 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c943e72d4db4b43e524f53553425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.332614 22466 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet e021c943e72d4db4b43e524f53553425
I20250112 21:02:30.332754 22626 tablet_service.cc:1467] Processing CreateTablet for tablet c0d105c1051c477f839d0d60304cf92f (DEFAULT_TABLE table=default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.332952 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d105c1051c477f839d0d60304cf92f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.333060 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 833b963c15c94c40b685b841defeec4f (DEFAULT_TABLE table=default.Table_f185eebd950d478c944225d297d83128 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.333292 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 833b963c15c94c40b685b841defeec4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.334275 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fda611fd0a4b3d91001ab926f74df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.334986 23037 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.335256 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.335464 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fda611fd0a4b3d91001ab926f74df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.335471 23034 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.335948 23037 tablet_bootstrap.cc:654] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.336349 23034 tablet_bootstrap.cc:654] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.336649 22625 tablet_service.cc:1467] Processing CreateTablet for tablet 75009f9e6889456da2792ebe20712b7b (DEFAULT_TABLE table=default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.336856 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75009f9e6889456da2792ebe20712b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.336665 22626 tablet_service.cc:1467] Processing CreateTablet for tablet e021c943e72d4db4b43e524f53553425 (DEFAULT_TABLE table=default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.337451 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021c943e72d4db4b43e524f53553425. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.338296 22624 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.339218 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
W20250112 21:02:30.339414 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet c0d105c1051c477f839d0d60304cf92f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0d105c1051c477f839d0d60304cf92f already in progress: creating tablet
W20250112 21:02:30.339684 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet e021c943e72d4db4b43e524f53553425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e021c943e72d4db4b43e524f53553425 already in progress: creating tablet
I20250112 21:02:30.339726 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:30.339880 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet c0d105c1051c477f839d0d60304cf92f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0d105c1051c477f839d0d60304cf92f already in progress: creating tablet
I20250112 21:02:30.340648 22466 master_service.cc:946] ReplaceTablet: received request to replace tablet e18b928a80ae4d3b906ac04855357f2c from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.340649 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:30.340713 22452 catalog_manager.cc:4839] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet c0d105c1051c477f839d0d60304cf92f because the tablet was not found. No further retry: Not found: Tablet not found: c0d105c1051c477f839d0d60304cf92f
W20250112 21:02:30.341065 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet e021c943e72d4db4b43e524f53553425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e021c943e72d4db4b43e524f53553425 already in progress: creating tablet
I20250112 21:02:30.341326 22464 master_service.cc:946] ReplaceTablet: received request to replace tablet e18b928a80ae4d3b906ac04855357f2c from {username='slave'} at 127.0.0.1:39888
W20250112 21:02:30.341610 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet e021c943e72d4db4b43e524f53553425 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e021c943e72d4db4b43e524f53553425 already in progress: creating tablet
I20250112 21:02:30.341833 23034 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.341837 23041 raft_consensus.cc:491] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.341920 23034 ts_tablet_manager.cc:1397] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:30.341930 23041 raft_consensus.cc:513] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.342284 23041 leader_election.cc:290] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.342813 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd8f02ab7724035a17ee0b0ceacd28e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.342813 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd8f02ab7724035a17ee0b0ceacd28e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.342938 22647 raft_consensus.cc:2463] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.342938 22917 raft_consensus.cc:2463] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.343173 22717 leader_election.cc:304] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.343330 23041 raft_consensus.cc:2798] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.343386 23041 raft_consensus.cc:491] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.343420 23041 raft_consensus.cc:3054] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.343976 23034 raft_consensus.cc:357] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.344080 23034 raft_consensus.cc:383] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.344110 23034 raft_consensus.cc:738] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.344238 23034 consensus_queue.cc:260] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.344283 23041 raft_consensus.cc:513] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.344529 23034 ts_tablet_manager.cc:1428] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.344651 23041 leader_election.cc:290] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.344722 23034 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.344973 23084 tablet.cc:1716] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Skipping requested alter to schema version 2, tablet already version 2
I20250112 21:02:30.344998 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd8f02ab7724035a17ee0b0ceacd28e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.345096 22917 raft_consensus.cc:3054] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.345744 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cd8f02ab7724035a17ee0b0ceacd28e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.345855 22647 raft_consensus.cc:3054] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.345913 22917 raft_consensus.cc:2463] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.346230 22717 leader_election.cc:304] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.346379 23041 raft_consensus.cc:2798] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.346446 23041 raft_consensus.cc:695] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.346704 22647 raft_consensus.cc:2463] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.346810 23041 consensus_queue.cc:237] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.346952 23034 tablet_bootstrap.cc:654] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.347903 23034 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.347986 23034 ts_tablet_manager.cc:1397] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.348426 23034 raft_consensus.cc:357] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.348522 23034 raft_consensus.cc:383] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.348564 23034 raft_consensus.cc:738] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.348634 23037 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.348673 23034 consensus_queue.cc:260] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.348728 23037 ts_tablet_manager.cc:1397] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250112 21:02:30.348929 23034 ts_tablet_manager.cc:1428] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.349107 23034 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.349155 23037 raft_consensus.cc:357] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.349264 23037 raft_consensus.cc:383] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.349309 23037 raft_consensus.cc:738] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.349427 23037 consensus_queue.cc:260] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.349701 23037 ts_tablet_manager.cc:1428] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.349884 23037 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.350041 23034 tablet_bootstrap.cc:654] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.350884 23037 tablet_bootstrap.cc:654] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.351389 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet e18b928a80ae4d3b906ac04855357f2c
I20250112 21:02:30.351675 22462 catalog_manager.cc:6596] ReplaceTablet: tablet e18b928a80ae4d3b906ac04855357f2c deleted and replaced by tablet 130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.352456 23034 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.352527 23034 ts_tablet_manager.cc:1397] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250112 21:02:30.352936 23034 raft_consensus.cc:357] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.353030 23034 raft_consensus.cc:383] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.353067 23034 raft_consensus.cc:738] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.353173 23034 consensus_queue.cc:260] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.353436 23034 ts_tablet_manager.cc:1428] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.353493 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet e18b928a80ae4d3b906ac04855357f2c with delete_type TABLET_DATA_DELETED (replaced by tablet 130ec7f6484644f1a36c01b3e9440b9b) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.353591 23034 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.353674 23038 tablet_replica.cc:331] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.353786 23038 raft_consensus.cc:2238] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.353885 23038 raft_consensus.cc:2267] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.354298 23038 ts_tablet_manager.cc:1905] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.354472 23034 tablet_bootstrap.cc:654] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.354485 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet e18b928a80ae4d3b906ac04855357f2c with delete_type TABLET_DATA_DELETED (replaced by tablet 130ec7f6484644f1a36c01b3e9440b9b) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.354650 23040 tablet_replica.cc:331] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.354754 23040 raft_consensus.cc:2238] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.354846 23040 raft_consensus.cc:2267] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.354934 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet e18b928a80ae4d3b906ac04855357f2c with delete_type TABLET_DATA_DELETED (replaced by tablet 130ec7f6484644f1a36c01b3e9440b9b) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.355137 23039 tablet_replica.cc:331] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.355265 23039 raft_consensus.cc:2238] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.355317 23037 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.355362 23039 raft_consensus.cc:2267] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.355396 23037 ts_tablet_manager.cc:1397] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20250112 21:02:30.355742 23037 raft_consensus.cc:357] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.355836 23037 raft_consensus.cc:383] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.355865 23037 raft_consensus.cc:738] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.355991 23037 consensus_queue.cc:260] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.356302 23037 ts_tablet_manager.cc:1428] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.356297 23038 ts_tablet_manager.cc:1918] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.356361 23038 log.cc:1198] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/e18b928a80ae4d3b906ac04855357f2c
I20250112 21:02:30.356487 23037 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.356575 23038 ts_tablet_manager.cc:1939] T e18b928a80ae4d3b906ac04855357f2c P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.357618 23037 tablet_bootstrap.cc:654] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.357632 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet e18b928a80ae4d3b906ac04855357f2c (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.358117 23040 ts_tablet_manager.cc:1905] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.359771 23039 ts_tablet_manager.cc:1905] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.359875 23040 ts_tablet_manager.cc:1918] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.359923 23040 log.cc:1198] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/e18b928a80ae4d3b906ac04855357f2c
I20250112 21:02:30.360069 23040 ts_tablet_manager.cc:1939] T e18b928a80ae4d3b906ac04855357f2c P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.361117 23037 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.361186 23037 ts_tablet_manager.cc:1397] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:30.361541 23037 raft_consensus.cc:357] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.361624 23037 raft_consensus.cc:383] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.361649 23037 raft_consensus.cc:738] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.361757 23037 consensus_queue.cc:260] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.361860 23039 ts_tablet_manager.cc:1918] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.361924 23039 log.cc:1198] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/e18b928a80ae4d3b906ac04855357f2c
I20250112 21:02:30.361980 23037 ts_tablet_manager.cc:1428] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.362092 23039 ts_tablet_manager.cc:1939] T e18b928a80ae4d3b906ac04855357f2c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.362128 23037 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.363022 23037 tablet_bootstrap.cc:654] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.363543 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet e18b928a80ae4d3b906ac04855357f2c (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.363685 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet e18b928a80ae4d3b906ac04855357f2c (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.364133 23036 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.364126 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 0644eab03d36474cbe6f363d15e36e73 (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.364223 23036 ts_tablet_manager.cc:1397] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250112 21:02:30.364351 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644eab03d36474cbe6f363d15e36e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.364679 23036 raft_consensus.cc:357] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.364768 23036 raft_consensus.cc:383] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.364789 23036 raft_consensus.cc:738] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.364893 23036 consensus_queue.cc:260] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.365131 23036 ts_tablet_manager.cc:1428] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.365291 23036 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.366322 23036 tablet_bootstrap.cc:654] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.366741 23037 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.366814 23037 ts_tablet_manager.cc:1397] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:30.367393 23036 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.367467 23036 ts_tablet_manager.cc:1397] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.367951 23036 raft_consensus.cc:357] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.368067 23036 raft_consensus.cc:383] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.367973 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 0644eab03d36474cbe6f363d15e36e73 (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.368100 23036 raft_consensus.cc:738] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.368271 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644eab03d36474cbe6f363d15e36e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.368235 23036 consensus_queue.cc:260] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.368348 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 0644eab03d36474cbe6f363d15e36e73 (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.368614 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0644eab03d36474cbe6f363d15e36e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.369455 23036 ts_tablet_manager.cc:1428] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.370170 23036 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.370357 23037 raft_consensus.cc:357] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.370606 23037 raft_consensus.cc:383] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.370649 23037 raft_consensus.cc:738] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.370781 23037 consensus_queue.cc:260] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.371119 23036 tablet_bootstrap.cc:654] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.372032 22459 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_050e64efa6ef46c1a9e5d89b3b7adf83 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 1 got 0
I20250112 21:02:30.372210 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 4cd8f02ab7724035a17ee0b0ceacd28e
I20250112 21:02:30.372259 22460 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248] alter complete (version 2)
I20250112 21:02:30.372927 23037 ts_tablet_manager.cc:1428] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:30.373204 23037 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.374302 23037 tablet_bootstrap.cc:654] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.375255 23037 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.375325 23037 ts_tablet_manager.cc:1397] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.375322 23036 tablet_bootstrap.cc:492] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.375568 23036 ts_tablet_manager.cc:1397] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:30.375730 23037 raft_consensus.cc:357] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.375746 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b (DEFAULT_TABLE table=default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.375810 23037 raft_consensus.cc:383] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.375841 23037 raft_consensus.cc:738] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.375955 23037 consensus_queue.cc:260] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.376014 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.376001 23036 raft_consensus.cc:357] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.376080 23036 raft_consensus.cc:383] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.376111 23036 raft_consensus.cc:738] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.375960 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130ec7f6484644f1a36c01b3e9440b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.376202 23037 ts_tablet_manager.cc:1428] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.376238 23036 consensus_queue.cc:260] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.376359 23037 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.377310 23037 tablet_bootstrap.cc:654] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.377564 23036 ts_tablet_manager.cc:1428] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.378260 23036 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:30.378324 22831 tablet.cc:2367] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250112 21:02:30.379123 23036 tablet_bootstrap.cc:654] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.380333 23036 tablet_bootstrap.cc:492] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.380491 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.380648 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet e18b928a80ae4d3b906ac04855357f2c with delete_type TABLET_DATA_DELETED (replaced by tablet 130ec7f6484644f1a36c01b3e9440b9b) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.380930 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b (DEFAULT_TABLE table=default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.381047 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cd8f02ab7724035a17ee0b0ceacd28e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.381158 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130ec7f6484644f1a36c01b3e9440b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.381181 23038 tablet_replica.cc:331] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.381181 23039 tablet_replica.cc:331] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.381271 23038 raft_consensus.cc:2238] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.381278 23039 raft_consensus.cc:2238] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.381353 23038 raft_consensus.cc:2267] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.381415 23039 pending_rounds.cc:62] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:30.381498 23039 pending_rounds.cc:69] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587713421803520 op_type: NO_OP noop_request { }
I20250112 21:02:30.381563 23039 raft_consensus.cc:2883] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.381621 23039 raft_consensus.cc:2267] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.381749 23038 ts_tablet_manager.cc:1905] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.382396 23039 ts_tablet_manager.cc:1905] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.380966 23036 ts_tablet_manager.cc:1397] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.383131 23036 raft_consensus.cc:357] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.383226 23036 raft_consensus.cc:383] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.383261 23036 raft_consensus.cc:738] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.383366 23036 consensus_queue.cc:260] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.383546 23038 ts_tablet_manager.cc:1918] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.383612 23038 log.cc:1198] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/4cd8f02ab7724035a17ee0b0ceacd28e
I20250112 21:02:30.383802 23038 ts_tablet_manager.cc:1939] T 4cd8f02ab7724035a17ee0b0ceacd28e P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.383875 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.384472 23037 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.384562 23037 ts_tablet_manager.cc:1397] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250112 21:02:30.384967 23037 raft_consensus.cc:357] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.385066 23037 raft_consensus.cc:383] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.385102 23037 raft_consensus.cc:738] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.385210 23037 consensus_queue.cc:260] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.383617 23036 ts_tablet_manager.cc:1428] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.385457 23037 ts_tablet_manager.cc:1428] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.385641 23037 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.385670 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 4cd8f02ab7724035a17ee0b0ceacd28e (table default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]) successfully deleted
I20250112 21:02:30.385843 23036 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.386528 23037 tablet_bootstrap.cc:654] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.386683 23036 tablet_bootstrap.cc:654] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.387053 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.387174 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.388134 23039 ts_tablet_manager.cc:1918] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.388351 23039 log.cc:1198] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/4cd8f02ab7724035a17ee0b0ceacd28e
I20250112 21:02:30.388672 23039 ts_tablet_manager.cc:1939] T 4cd8f02ab7724035a17ee0b0ceacd28e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.388866 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.389389 23039 tablet_replica.cc:331] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.389392 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 4cd8f02ab7724035a17ee0b0ceacd28e (table default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]) successfully deleted
I20250112 21:02:30.389540 23039 raft_consensus.cc:2238] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.389683 23039 raft_consensus.cc:2267] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:30.389803 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet e18b928a80ae4d3b906ac04855357f2c because the tablet was not found. No further retry: Not found: Tablet not found: e18b928a80ae4d3b906ac04855357f2c
I20250112 21:02:30.390139 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet c0d105c1051c477f839d0d60304cf92f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.390151 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet e021c943e72d4db4b43e524f53553425 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.390344 23038 tablet_replica.cc:331] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.390447 23038 raft_consensus.cc:2238] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.390440 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b (DEFAULT_TABLE table=default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.390529 23038 raft_consensus.cc:2267] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.390648 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130ec7f6484644f1a36c01b3e9440b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.390892 23038 ts_tablet_manager.cc:1905] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.392158 23038 ts_tablet_manager.cc:1918] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.392217 23038 log.cc:1198] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/c0d105c1051c477f839d0d60304cf92f
I20250112 21:02:30.392431 23038 ts_tablet_manager.cc:1939] T c0d105c1051c477f839d0d60304cf92f P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.392854 23038 tablet_replica.cc:331] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.392947 23038 raft_consensus.cc:2238] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.392952 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet c0d105c1051c477f839d0d60304cf92f (table default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]) successfully deleted
I20250112 21:02:30.393025 23038 raft_consensus.cc:2267] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.393280 23040 tablet_replica.cc:331] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.393355 23038 ts_tablet_manager.cc:1905] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.393393 23040 raft_consensus.cc:2238] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.393487 23040 raft_consensus.cc:2267] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.393894 23040 ts_tablet_manager.cc:1905] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.393980 23039 ts_tablet_manager.cc:1905] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.394871 23038 ts_tablet_manager.cc:1918] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.394928 23038 log.cc:1198] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/e021c943e72d4db4b43e524f53553425
I20250112 21:02:30.395097 23038 ts_tablet_manager.cc:1939] T e021c943e72d4db4b43e524f53553425 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.395399 23034 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.395473 23034 ts_tablet_manager.cc:1397] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.000s
I20250112 21:02:30.395507 23037 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.395572 23037 ts_tablet_manager.cc:1397] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:30.395650 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet e021c943e72d4db4b43e524f53553425 (table default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]) successfully deleted
I20250112 21:02:30.395911 23034 raft_consensus.cc:357] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.396003 23040 ts_tablet_manager.cc:1918] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.396023 23034 raft_consensus.cc:383] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.395988 23037 raft_consensus.cc:357] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.396055 23034 raft_consensus.cc:738] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.396060 23040 log.cc:1198] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/4cd8f02ab7724035a17ee0b0ceacd28e
I20250112 21:02:30.396238 23040 ts_tablet_manager.cc:1939] T 4cd8f02ab7724035a17ee0b0ceacd28e P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.396210 23034 consensus_queue.cc:260] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.396068 23037 raft_consensus.cc:383] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.396430 23037 raft_consensus.cc:738] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.396571 23037 consensus_queue.cc:260] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.397790 23037 ts_tablet_manager.cc:1428] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.397959 23037 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.398675 23036 tablet_bootstrap.cc:492] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.398747 23036 ts_tablet_manager.cc:1397] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250112 21:02:30.399044 23037 tablet_bootstrap.cc:654] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.399163 23036 raft_consensus.cc:357] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.399271 23036 raft_consensus.cc:383] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.399304 23036 raft_consensus.cc:738] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.399411 23036 consensus_queue.cc:260] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.399673 23036 ts_tablet_manager.cc:1428] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.399829 23036 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.400748 23036 tablet_bootstrap.cc:654] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.400939 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 4cd8f02ab7724035a17ee0b0ceacd28e (table default.Table_9aedf334cda8457abe817ed20475d648 [id=10b51d9f8d7241e9ab8b5eb3100c409e]) successfully deleted
I20250112 21:02:30.401263 23034 ts_tablet_manager.cc:1428] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:30.401728 23036 tablet_bootstrap.cc:492] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.401842 23036 ts_tablet_manager.cc:1397] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.402050 23040 tablet_replica.cc:331] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.402169 23040 raft_consensus.cc:2238] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.402266 23040 raft_consensus.cc:2267] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.402455 23036 raft_consensus.cc:357] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.402616 23036 raft_consensus.cc:383] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.402681 23040 ts_tablet_manager.cc:1905] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.402693 23036 raft_consensus.cc:738] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.402880 23036 consensus_queue.cc:260] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.403177 23036 ts_tablet_manager.cc:1428] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.403327 23037 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.403400 23037 ts_tablet_manager.cc:1397] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:30.403797 23037 raft_consensus.cc:357] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.403887 23037 raft_consensus.cc:383] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.403923 23037 raft_consensus.cc:738] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.404035 23037 consensus_queue.cc:260] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.404083 23036 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.404286 23037 ts_tablet_manager.cc:1428] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.405082 23036 tablet_bootstrap.cc:654] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.405318 23034 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.405397 22459 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
W20250112 21:02:30.405691 22459 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 130ec7f6484644f1a36c01b3e9440b9b consensus state has no leader
I20250112 21:02:30.406332 23034 tablet_bootstrap.cc:654] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.407923 23039 ts_tablet_manager.cc:1918] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.407917 23051 raft_consensus.cc:491] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.408000 23039 log.cc:1198] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/e021c943e72d4db4b43e524f53553425
I20250112 21:02:30.408002 23051 raft_consensus.cc:513] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.408118 23049 raft_consensus.cc:491] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.408198 23049 raft_consensus.cc:513] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.408250 23039 ts_tablet_manager.cc:1939] T e021c943e72d4db4b43e524f53553425 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.408882 23039 tablet_replica.cc:331] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.408967 23034 tablet_bootstrap.cc:492] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.409056 23034 ts_tablet_manager.cc:1397] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:30.409082 23039 raft_consensus.cc:2238] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.409204 23051 leader_election.cc:290] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.409304 23039 raft_consensus.cc:2267] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.409474 23034 raft_consensus.cc:357] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.409581 23034 raft_consensus.cc:383] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.409610 23034 raft_consensus.cc:738] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.409610 22459 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
I20250112 21:02:30.409749 23034 consensus_queue.cc:260] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.410298 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet e021c943e72d4db4b43e524f53553425 (table default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]) successfully deleted
I20250112 21:02:30.411356 23034 ts_tablet_manager.cc:1428] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.411904 23049 leader_election.cc:290] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.412480 23039 ts_tablet_manager.cc:1905] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.414016 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd94918fa1384a56a246af2afd4a3aff" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.414016 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f19de7823b40c1ba7ed03d2d8adfcd" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.414242 22781 raft_consensus.cc:2463] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.414265 22782 raft_consensus.cc:2463] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.414599 23040 ts_tablet_manager.cc:1918] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.414655 22580 leader_election.cc:304] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.414750 23039 ts_tablet_manager.cc:1918] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.414817 23039 log.cc:1198] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/c0d105c1051c477f839d0d60304cf92f
I20250112 21:02:30.414887 22580 leader_election.cc:304] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.415005 23039 ts_tablet_manager.cc:1939] T c0d105c1051c477f839d0d60304cf92f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.415061 23049 raft_consensus.cc:2798] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.415125 23049 raft_consensus.cc:491] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.415201 23049 raft_consensus.cc:3054] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.415256 23051 raft_consensus.cc:2798] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.415303 23051 raft_consensus.cc:491] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.415344 23051 raft_consensus.cc:3054] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.415565 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet c0d105c1051c477f839d0d60304cf92f (table default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]) successfully deleted
I20250112 21:02:30.416036 23049 raft_consensus.cc:513] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.416090 23051 raft_consensus.cc:513] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.416363 23049 leader_election.cc:290] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.416378 23051 leader_election.cc:290] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.414669 23040 log.cc:1198] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/c0d105c1051c477f839d0d60304cf92f
I20250112 21:02:30.416769 23040 ts_tablet_manager.cc:1939] T c0d105c1051c477f839d0d60304cf92f P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.416536 23034 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.416743 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f19de7823b40c1ba7ed03d2d8adfcd" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.416806 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd94918fa1384a56a246af2afd4a3aff" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.416996 22782 raft_consensus.cc:3054] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.416998 22781 raft_consensus.cc:3054] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.417279 23040 tablet_replica.cc:331] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.417384 23040 raft_consensus.cc:2238] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.417481 23040 raft_consensus.cc:2267] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.417485 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet c0d105c1051c477f839d0d60304cf92f (table default.Table_a2b0ee75b38b434fb420b9a519603971 [id=b0b95067cbf044b884a9d4584fb244de]) successfully deleted
I20250112 21:02:30.417857 22782 raft_consensus.cc:2463] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.417958 22781 raft_consensus.cc:2463] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.418238 22580 leader_election.cc:304] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.418383 22580 leader_election.cc:304] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.418432 23051 raft_consensus.cc:2798] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.418634 23051 raft_consensus.cc:695] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.418861 23051 consensus_queue.cc:237] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.419055 23034 tablet_bootstrap.cc:654] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.419037 23118 raft_consensus.cc:2798] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.419307 23118 raft_consensus.cc:695] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.419485 23118 consensus_queue.cc:237] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.420377 23034 tablet_bootstrap.cc:492] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.420516 23034 ts_tablet_manager.cc:1397] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:30.420889 23034 raft_consensus.cc:357] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.420969 23034 raft_consensus.cc:383] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.420998 23034 raft_consensus.cc:738] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.421105 23034 consensus_queue.cc:260] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.421437 23034 ts_tablet_manager.cc:1428] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.421635 23034 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.422483 23034 tablet_bootstrap.cc:654] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.422957 22459 catalog_manager.cc:5526] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.423167 22459 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_050e64efa6ef46c1a9e5d89b3b7adf83 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 1 got 0
I20250112 21:02:30.423295 22459 catalog_manager.cc:5526] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.423471 22459 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:30.425058 23040 ts_tablet_manager.cc:1905] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.428323 23040 ts_tablet_manager.cc:1918] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.428391 23040 log.cc:1198] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/e021c943e72d4db4b43e524f53553425
I20250112 21:02:30.428602 23040 ts_tablet_manager.cc:1939] T e021c943e72d4db4b43e524f53553425 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.429179 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet e021c943e72d4db4b43e524f53553425 (table default.Table_dca486ee48eb4525b18f1b2cf11a5d6e [id=b8c193513123448785ce290fab348934]) successfully deleted
I20250112 21:02:30.430711 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f19de7823b40c1ba7ed03d2d8adfcd" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.430850 22917 raft_consensus.cc:2463] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.431026 22918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd94918fa1384a56a246af2afd4a3aff" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.431100 22918 raft_consensus.cc:2463] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.431267 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd94918fa1384a56a246af2afd4a3aff" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.431351 22916 raft_consensus.cc:3054] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.432266 22916 raft_consensus.cc:2463] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.432478 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f19de7823b40c1ba7ed03d2d8adfcd" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.432557 22915 raft_consensus.cc:3054] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.432983 23036 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.433065 23036 ts_tablet_manager.cc:1397] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250112 21:02:30.433398 22915 raft_consensus.cc:2463] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.433542 23036 raft_consensus.cc:357] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.433599 23034 tablet_bootstrap.cc:492] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.433633 23036 raft_consensus.cc:383] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.433665 23036 raft_consensus.cc:738] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.433670 23034 ts_tablet_manager.cc:1397] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250112 21:02:30.433781 23036 consensus_queue.cc:260] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.434034 23036 ts_tablet_manager.cc:1428] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.434072 23034 raft_consensus.cc:357] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.434159 23034 raft_consensus.cc:383] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.434187 23034 raft_consensus.cc:738] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.434213 23036 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.434311 23034 consensus_queue.cc:260] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.434621 22283 external_mini_cluster.cc:1351] Running /tmp/dist-test-task2b0lOt/build/debug/bin/kudu
/tmp/dist-test-task2b0lOt/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.254:46215
--webserver_interface=127.21.194.254
--webserver_port=33441
--builtin_ntp_servers=127.21.194.212:38917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250112 21:02:30.435019 23034 ts_tablet_manager.cc:1428] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.435132 23036 tablet_bootstrap.cc:654] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.435181 23034 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.435925 23034 tablet_bootstrap.cc:654] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.438591 22915 raft_consensus.cc:1270] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.439045 23036 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.439117 23036 ts_tablet_manager.cc:1397] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:30.439244 22781 raft_consensus.cc:1270] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.439723 23118 consensus_queue.cc:1035] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.439508 23036 raft_consensus.cc:357] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.439982 23036 raft_consensus.cc:383] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.440017 23036 raft_consensus.cc:738] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.440284 23118 consensus_queue.cc:1035] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.440150 23036 consensus_queue.cc:260] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.441730 23034 tablet_bootstrap.cc:492] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.441803 23034 ts_tablet_manager.cc:1397] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:30.442196 23034 raft_consensus.cc:357] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.442287 23034 raft_consensus.cc:383] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.442317 23034 raft_consensus.cc:738] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.442478 23034 consensus_queue.cc:260] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.442720 23036 ts_tablet_manager.cc:1428] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:30.443517 23034 ts_tablet_manager.cc:1428] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.445138 22460 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_050e64efa6ef46c1a9e5d89b3b7adf83 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 1 got 0
I20250112 21:02:30.445271 22460 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
I20250112 21:02:30.446870 22460 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_6cfb064087fd4bd8b7ede81666c1fdbe [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 1 got 0
I20250112 21:02:30.446981 22460 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_050e64efa6ef46c1a9e5d89b3b7adf83 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 1 got 0
I20250112 21:02:30.450376 23083 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.450662 23084 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.454532 23041 raft_consensus.cc:491] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.454612 23041 raft_consensus.cc:513] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.454941 23041 leader_election.cc:290] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.455675 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "833b963c15c94c40b685b841defeec4f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.455720 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_624f4605a9ab4e2ea3f152df04bcd56b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.455798 22647 raft_consensus.cc:2463] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
W20250112 21:02:30.456038 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_624f4605a9ab4e2ea3f152df04bcd56b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.456156 22715 leader_election.cc:304] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.456420 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "833b963c15c94c40b685b841defeec4f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.456532 22915 raft_consensus.cc:2463] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.456820 23041 raft_consensus.cc:2798] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.456882 23041 raft_consensus.cc:491] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.456918 23041 raft_consensus.cc:3054] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.457336 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_689dd39940394a37b6ef3ad96a9eb3c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.457667 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_689dd39940394a37b6ef3ad96a9eb3c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.457818 23041 raft_consensus.cc:513] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.458159 23041 leader_election.cc:290] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.458575 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "833b963c15c94c40b685b841defeec4f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.458582 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "833b963c15c94c40b685b841defeec4f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.458683 22647 raft_consensus.cc:3054] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.458679 22915 raft_consensus.cc:3054] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.459532 22915 raft_consensus.cc:2463] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.459563 22647 raft_consensus.cc:2463] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.459851 22717 leader_election.cc:304] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.459897 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f94af44918694b88b8d57027a6ad4d4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.460225 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f94af44918694b88b8d57027a6ad4d4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.460495 23041 raft_consensus.cc:2798] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.460590 23041 raft_consensus.cc:695] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.460714 23041 consensus_queue.cc:237] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.463393 22457 catalog_manager.cc:5526] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.467700 23081 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.472699 23046 raft_consensus.cc:491] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.472801 23046 raft_consensus.cc:513] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.473675 22915 raft_consensus.cc:1270] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.473886 23046 leader_election.cc:290] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.473954 22781 raft_consensus.cc:1270] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.474481 23051 consensus_queue.cc:1035] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.475584 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f90e77f194c947578af0716fc048db2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.475785 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c66934d30a0b43e283881965d2d1628e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.475919 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f90e77f194c947578af0716fc048db2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.476085 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c66934d30a0b43e283881965d2d1628e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.476559 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_3efed8387f734f2896cc733cf475fe00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.476814 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3efed8387f734f2896cc733cf475fe00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.477694 23077 mvcc.cc:204] Tried to move back new op lower bound from 7113587713932455936 to 7113587713720602624. Current Snapshot: MvccSnapshot[applied={T|T < 7113587713932455936}]
I20250112 21:02:30.478063 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_d5adf7b63dfd4ab2bfac21301d6669e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.478353 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5adf7b63dfd4ab2bfac21301d6669e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.479327 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_fbc86351fd1f4869bdb002b6fe76ba8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.479413 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8e1b222fdb06461c9037ff2390b8dd73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.479441 23049 consensus_queue.cc:1035] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:30.479620 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbc86351fd1f4869bdb002b6fe76ba8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.479696 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e1b222fdb06461c9037ff2390b8dd73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.480808 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96801602ee9d4ab7a19e1a46421b5f0d" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.480926 22647 raft_consensus.cc:2463] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.481133 23084 tablet.cc:1721] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.481267 22851 leader_election.cc:304] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.481940 23046 raft_consensus.cc:2798] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.481994 23046 raft_consensus.cc:491] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.482028 23046 raft_consensus.cc:3054] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.483304 23046 raft_consensus.cc:513] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.483408 23081 tablet.cc:1721] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.483623 23046 leader_election.cc:290] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.483783 23065 raft_consensus.cc:491] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.483865 23065 raft_consensus.cc:513] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.484184 23065 leader_election.cc:290] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.484617 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f185eebd950d478c944225d297d83128" } new_table_name: "default.Table_3f4664e903e641f49a309dfa855e3266" modify_external_catalogs: true
I20250112 21:02:30.484901 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0644eab03d36474cbe6f363d15e36e73" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.485020 22647 raft_consensus.cc:2463] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.486440 22464 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:30.486481 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96801602ee9d4ab7a19e1a46421b5f0d" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.486567 22647 raft_consensus.cc:3054] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.486573 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96801602ee9d4ab7a19e1a46421b5f0d" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.486680 22782 raft_consensus.cc:2463] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.486917 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96801602ee9d4ab7a19e1a46421b5f0d" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.486948 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0644eab03d36474cbe6f363d15e36e73" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.487000 22780 raft_consensus.cc:3054] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.487052 22915 raft_consensus.cc:2463] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.487511 22647 raft_consensus.cc:2463] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.487983 22780 raft_consensus.cc:2463] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.488499 22717 leader_election.cc:304] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.488942 22460 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_050e64efa6ef46c1a9e5d89b3b7adf83 [id=83aa4d12b5d24a628351eb0a6b975cb7] alter complete (version 1)
I20250112 21:02:30.489145 22851 leader_election.cc:304] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.491878 23046 raft_consensus.cc:2798] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.491961 23046 raft_consensus.cc:695] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:30.492163 23046 consensus_queue.cc:237] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.495150 22464 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_050e64efa6ef46c1a9e5d89b3b7adf83" } new_table_name: "default.Table_f5d73d2eb66444888ba1c47a516b5da4" modify_external_catalogs: true
I20250112 21:02:30.495333 22898 tablet_service.cc:1467] Processing CreateTablet for tablet bdeb12d12d3244dbac58127ebeb662cd (DEFAULT_TABLE table=default.Table_624f4605a9ab4e2ea3f152df04bcd56b [id=75df653ef27a498a96a8725368b32a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.495368 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 76421422c8544991b9da0f53a4272cd1 (DEFAULT_TABLE table=default.Table_689dd39940394a37b6ef3ad96a9eb3c9 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.495409 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.495604 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb12d12d3244dbac58127ebeb662cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.495887 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_6cfb064087fd4bd8b7ede81666c1fdbe" } new_table_name: "default.Table_a0822bb2ca63441c994a25cb64669d49" modify_external_catalogs: true
I20250112 21:02:30.496141 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.496214 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 76421422c8544991b9da0f53a4272cd1 (DEFAULT_TABLE table=default.Table_689dd39940394a37b6ef3ad96a9eb3c9 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.496387 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a252d2647f84d9aaac1fc26f0de81b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.496805 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76421422c8544991b9da0f53a4272cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.496945 22762 tablet_service.cc:1467] Processing CreateTablet for tablet bdeb12d12d3244dbac58127ebeb662cd (DEFAULT_TABLE table=default.Table_624f4605a9ab4e2ea3f152df04bcd56b [id=75df653ef27a498a96a8725368b32a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.497165 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb12d12d3244dbac58127ebeb662cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.497530 22623 tablet_service.cc:1467] Processing CreateTablet for tablet bdeb12d12d3244dbac58127ebeb662cd (DEFAULT_TABLE table=default.Table_624f4605a9ab4e2ea3f152df04bcd56b [id=75df653ef27a498a96a8725368b32a4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.497716 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdeb12d12d3244dbac58127ebeb662cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.498329 23037 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.499148 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 76421422c8544991b9da0f53a4272cd1 (DEFAULT_TABLE table=default.Table_689dd39940394a37b6ef3ad96a9eb3c9 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.499270 23037 tablet_bootstrap.cc:654] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.499372 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76421422c8544991b9da0f53a4272cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.499545 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.499745 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a252d2647f84d9aaac1fc26f0de81b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.501358 23041 raft_consensus.cc:2798] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.501413 23041 raft_consensus.cc:491] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.501451 23041 raft_consensus.cc:3054] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.501580 23034 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.502184 23041 raft_consensus.cc:513] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.502467 23034 tablet_bootstrap.cc:654] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.502544 23041 leader_election.cc:290] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.502866 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0644eab03d36474cbe6f363d15e36e73" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.502974 22915 raft_consensus.cc:3054] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.503584 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0644eab03d36474cbe6f363d15e36e73" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.503686 22647 raft_consensus.cc:3054] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.503800 22915 raft_consensus.cc:2463] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.504160 22717 leader_election.cc:304] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.504483 22647 raft_consensus.cc:2463] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.504492 23041 raft_consensus.cc:2798] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.505185 23041 raft_consensus.cc:695] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.505329 23036 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.505365 23041 consensus_queue.cc:237] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.506273 23036 tablet_bootstrap.cc:654] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.507743 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a252d2647f84d9aaac1fc26f0de81b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.507754 23083 tablet.cc:1721] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.510887 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76421422c8544991b9da0f53a4272cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.511809 22458 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_6b1bc98f952545e3a3f8bf654b07976c" } modify_external_catalogs: true
I20250112 21:02:30.511916 22458 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_6b1bc98f952545e3a3f8bf654b07976c" } modify_external_catalogs: true
I20250112 21:02:30.512174 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f3a29e661dd34f458c8ebeeaf8a33b68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.512557 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.513233 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_53c56a74430245e5a2f5fdf757849d0d" } modify_external_catalogs: true
I20250112 21:02:30.513320 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_53c56a74430245e5a2f5fdf757849d0d" } modify_external_catalogs: true
I20250112 21:02:30.513437 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_689dd39940394a37b6ef3ad96a9eb3c9" } new_table_name: "default.Table_3a97ce8861b64293baf4aaac6a4d79e5" modify_external_catalogs: true
W20250112 21:02:30.515043 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 130ec7f6484644f1a36c01b3e9440b9b consensus state has no leader
I20250112 21:02:30.515524 22461 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_f5d73d2eb66444888ba1c47a516b5da4 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 2 got 1
I20250112 21:02:30.516199 23037 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.516295 23037 ts_tablet_manager.cc:1397] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250112 21:02:30.516753 23037 raft_consensus.cc:357] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.516847 23037 raft_consensus.cc:383] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.516878 23037 raft_consensus.cc:738] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.516988 23037 consensus_queue.cc:260] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.517303 23037 ts_tablet_manager.cc:1428] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.517820 23037 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.518049 23034 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.518127 23034 ts_tablet_manager.cc:1397] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250112 21:02:30.518573 23034 raft_consensus.cc:357] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.518672 23034 raft_consensus.cc:383] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.518659 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 75009f9e6889456da2792ebe20712b7b
I20250112 21:02:30.518703 23034 raft_consensus.cc:738] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.518723 23037 tablet_bootstrap.cc:654] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.518821 23034 consensus_queue.cc:260] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.519109 23034 ts_tablet_manager.cc:1428] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.519152 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 75009f9e6889456da2792ebe20712b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.519286 23034 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.519795 23038 tablet_replica.cc:331] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.519920 23038 raft_consensus.cc:2238] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.520016 23038 raft_consensus.cc:2267] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.520541 23034 tablet_bootstrap.cc:654] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.520565 23038 ts_tablet_manager.cc:1905] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.522222 23038 ts_tablet_manager.cc:1918] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.522287 23038 log.cc:1198] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/75009f9e6889456da2792ebe20712b7b
I20250112 21:02:30.522289 23041 raft_consensus.cc:491] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.522359 23041 raft_consensus.cc:513] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.522497 23038 ts_tablet_manager.cc:1939] T 75009f9e6889456da2792ebe20712b7b P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.522704 23041 leader_election.cc:290] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.523066 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fda611fd0a4b3d91001ab926f74df0" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.523175 22647 raft_consensus.cc:2463] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.523487 22715 leader_election.cc:304] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.523569 22457 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d] alter complete (version 2)
I20250112 21:02:30.523763 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 75009f9e6889456da2792ebe20712b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.523916 23040 tablet_replica.cc:331] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.524031 23040 raft_consensus.cc:2238] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.524121 23040 raft_consensus.cc:2267] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.524578 23040 ts_tablet_manager.cc:1905] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.524549 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fda611fd0a4b3d91001ab926f74df0" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.524653 22915 raft_consensus.cc:2463] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.525030 23041 raft_consensus.cc:2798] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.525080 23041 raft_consensus.cc:491] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.525111 23041 raft_consensus.cc:3054] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.525746 22647 raft_consensus.cc:1270] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.525944 23041 raft_consensus.cc:513] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.526212 23082 consensus_queue.cc:1035] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.526446 23040 ts_tablet_manager.cc:1918] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.526507 23040 log.cc:1198] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/75009f9e6889456da2792ebe20712b7b
I20250112 21:02:30.526702 23040 ts_tablet_manager.cc:1939] T 75009f9e6889456da2792ebe20712b7b P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.526782 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fda611fd0a4b3d91001ab926f74df0" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.526876 22916 raft_consensus.cc:3054] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.526228 23041 leader_election.cc:290] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.527671 22916 raft_consensus.cc:2463] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.527915 22915 raft_consensus.cc:1270] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.528106 23037 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.528183 23037 ts_tablet_manager.cc:1397] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:30.528215 22717 leader_election.cc:304] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.528287 23135 raft_consensus.cc:491] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.528353 23135 raft_consensus.cc:513] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.528507 23082 raft_consensus.cc:2798] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.528578 23082 raft_consensus.cc:695] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.528656 23037 raft_consensus.cc:357] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.528713 23135 leader_election.cc:290] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.528754 23037 raft_consensus.cc:383] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.528692 23082 consensus_queue.cc:237] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.528780 23037 raft_consensus.cc:738] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.528877 23037 consensus_queue.cc:260] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.529098 23037 ts_tablet_manager.cc:1428] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.529312 22645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ab4d56670242c7ac1cfb180eabf3c5" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.529320 23082 consensus_queue.cc:1035] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.529410 22645 raft_consensus.cc:2463] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.529520 23034 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.529587 23034 ts_tablet_manager.cc:1397] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20250112 21:02:30.529982 23034 raft_consensus.cc:357] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.530010 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fda611fd0a4b3d91001ab926f74df0" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.530068 23034 raft_consensus.cc:383] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.530099 23034 raft_consensus.cc:738] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.530100 22647 raft_consensus.cc:3054] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.530185 23034 consensus_queue.cc:260] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.530442 23034 ts_tablet_manager.cc:1428] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.530604 23034 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.531546 23034 tablet_bootstrap.cc:654] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.531570 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 75009f9e6889456da2792ebe20712b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.531742 23039 tablet_replica.cc:331] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.531842 23039 raft_consensus.cc:2238] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.531924 23039 raft_consensus.cc:2267] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.532011 22647 raft_consensus.cc:2463] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.532356 23039 ts_tablet_manager.cc:1905] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.532882 22851 leader_election.cc:304] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.533031 23046 raft_consensus.cc:2798] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.533074 23046 raft_consensus.cc:491] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.533107 23046 raft_consensus.cc:3054] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.533396 22466 master_service.cc:946] ReplaceTablet: received request to replace tablet 130ec7f6484644f1a36c01b3e9440b9b from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.533572 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 75009f9e6889456da2792ebe20712b7b (table default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]) successfully deleted
I20250112 21:02:30.533900 23037 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.533941 23046 raft_consensus.cc:513] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.534240 23046 leader_election.cc:290] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.534279 23039 ts_tablet_manager.cc:1918] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.534349 23039 log.cc:1198] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/75009f9e6889456da2792ebe20712b7b
I20250112 21:02:30.534523 23039 ts_tablet_manager.cc:1939] T 75009f9e6889456da2792ebe20712b7b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.535880 23037 tablet_bootstrap.cc:654] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.536569 22458 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_a200ec004be44c6eacd33f76133ab58e" } modify_external_catalogs: true
I20250112 21:02:30.536674 22458 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_a200ec004be44c6eacd33f76133ab58e" } modify_external_catalogs: true
I20250112 21:02:30.538077 22459 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_8e1b222fdb06461c9037ff2390b8dd73" } modify_external_catalogs: true
I20250112 21:02:30.538174 22459 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_8e1b222fdb06461c9037ff2390b8dd73" } modify_external_catalogs: true
W20250112 21:02:30.538347 22462 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76421422c8544991b9da0f53a4272cd1 consensus state has no leader
I20250112 21:02:30.539382 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ab4d56670242c7ac1cfb180eabf3c5" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.539491 22647 raft_consensus.cc:3054] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.540364 22647 raft_consensus.cc:2463] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.540737 22851 leader_election.cc:304] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.540889 23135 raft_consensus.cc:2798] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.540963 23135 raft_consensus.cc:695] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:30.541078 23135 consensus_queue.cc:237] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.542177 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ab4d56670242c7ac1cfb180eabf3c5" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.542299 22782 raft_consensus.cc:3054] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.543212 22782 raft_consensus.cc:2463] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.543344 23084 tablet.cc:1721] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.543560 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ab4d56670242c7ac1cfb180eabf3c5" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.543679 22780 raft_consensus.cc:2371] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1. Re-sending same reply.
I20250112 21:02:30.547451 23083 tablet.cc:1721] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.547798 23150 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.551146 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 42f011ccfe3741a09e48c51464f658ec (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.551384 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f011ccfe3741a09e48c51464f658ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.552064 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.552307 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe1bc020af84f039e1560c7ae4f9176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.552856 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 42f011ccfe3741a09e48c51464f658ec (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.553052 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 75009f9e6889456da2792ebe20712b7b (table default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]) successfully deleted
I20250112 21:02:30.553090 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f011ccfe3741a09e48c51464f658ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.553189 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 75009f9e6889456da2792ebe20712b7b (table default.Table_6b1bc98f952545e3a3f8bf654b07976c [id=27ee5042905d470d94f3a2a3e26eabf9]) successfully deleted
I20250112 21:02:30.553192 22627 tablet_service.cc:1467] Processing CreateTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c (DEFAULT_TABLE table=default.Table_f90e77f194c947578af0716fc048db2a [id=22d0a7749b274fcba077dd05309c7c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.553416 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c428b8f4aa1d45a8b04b64fc824dfe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.554275 22762 tablet_service.cc:1467] Processing CreateTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c (DEFAULT_TABLE table=default.Table_f90e77f194c947578af0716fc048db2a [id=22d0a7749b274fcba077dd05309c7c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.554473 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c428b8f4aa1d45a8b04b64fc824dfe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.555084 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 96801602ee9d4ab7a19e1a46421b5f0d
I20250112 21:02:30.555178 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.555393 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe1bc020af84f039e1560c7ae4f9176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.556280 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.556481 23040 tablet_replica.cc:331] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.556604 23040 raft_consensus.cc:2238] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.556694 23040 raft_consensus.cc:2267] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.557049 22460 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_a0822bb2ca63441c994a25cb64669d49" } new_table_name: "default.Table_709d0765a8bd447c92f9280f7ac23d67" modify_external_catalogs: true
I20250112 21:02:30.559247 23132 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.559950 23040 ts_tablet_manager.cc:1905] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.560097 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.560370 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe1bc020af84f039e1560c7ae4f9176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.560521 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.560672 23039 tablet_replica.cc:331] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.560781 23039 raft_consensus.cc:2238] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.560863 23039 raft_consensus.cc:2267] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.561022 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 42f011ccfe3741a09e48c51464f658ec (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.561164 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet 87fda611fd0a4b3d91001ab926f74df0 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.561232 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f011ccfe3741a09e48c51464f658ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.561322 22465 master_service.cc:946] ReplaceTablet: received request to replace tablet 505606e672b7403b81e9af1d6d954b3f from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.562356 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 96801602ee9d4ab7a19e1a46421b5f0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.562672 22459 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9fe38cb25c5e454d8e7069c048ffe6aa
I20250112 21:02:30.563166 22898 tablet_service.cc:1467] Processing CreateTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c (DEFAULT_TABLE table=default.Table_f90e77f194c947578af0716fc048db2a [id=22d0a7749b274fcba077dd05309c7c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.563282 23081 tablet.cc:1721] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.563365 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c428b8f4aa1d45a8b04b64fc824dfe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.563453 23038 tablet_replica.cc:331] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.563591 23038 raft_consensus.cc:2238] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.563820 23038 pending_rounds.cc:62] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Trying to abort 1 pending ops.
I20250112 21:02:30.563901 23038 pending_rounds.cc:69] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714018385920 op_type: NO_OP noop_request { }
I20250112 21:02:30.563969 23038 raft_consensus.cc:2883] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.564031 23038 raft_consensus.cc:2267] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.564396 23039 ts_tablet_manager.cc:1905] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.564672 23038 ts_tablet_manager.cc:1905] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.565052 23081 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:30.566233 23039 ts_tablet_manager.cc:1918] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.566300 23039 log.cc:1198] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/96801602ee9d4ab7a19e1a46421b5f0d
I20250112 21:02:30.566431 23038 ts_tablet_manager.cc:1918] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.566489 23038 log.cc:1198] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/96801602ee9d4ab7a19e1a46421b5f0d
I20250112 21:02:30.566493 22459 master_service.cc:946] ReplaceTablet: received request to replace tablet 76421422c8544991b9da0f53a4272cd1 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.566828 23038 ts_tablet_manager.cc:1939] T 96801602ee9d4ab7a19e1a46421b5f0d P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
W20250112 21:02:30.567859 22460 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 130ec7f6484644f1a36c01b3e9440b9b consensus state has no leader
I20250112 21:02:30.568782 23036 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.568856 23036 ts_tablet_manager.cc:1397] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.000s
I20250112 21:02:30.569211 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_53c56a74430245e5a2f5fdf757849d0d [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.569257 23036 raft_consensus.cc:357] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.569347 23036 raft_consensus.cc:383] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.569377 23036 raft_consensus.cc:738] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.569417 23039 ts_tablet_manager.cc:1939] T 96801602ee9d4ab7a19e1a46421b5f0d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.569486 23036 consensus_queue.cc:260] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.569763 23036 ts_tablet_manager.cc:1428] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.569929 23036 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.570756 23036 tablet_bootstrap.cc:654] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.571240 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_53c56a74430245e5a2f5fdf757849d0d [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.572322 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 505606e672b7403b81e9af1d6d954b3f
I20250112 21:02:30.572595 22465 catalog_manager.cc:6596] ReplaceTablet: tablet 505606e672b7403b81e9af1d6d954b3f deleted and replaced by tablet 5269be30c3f541c8a2531356e5f4fdc0
I20250112 21:02:30.572883 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 505606e672b7403b81e9af1d6d954b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 5269be30c3f541c8a2531356e5f4fdc0) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.572953 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 505606e672b7403b81e9af1d6d954b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 5269be30c3f541c8a2531356e5f4fdc0) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.573098 23039 tablet_replica.cc:331] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.573220 23039 raft_consensus.cc:2238] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.573421 23039 raft_consensus.cc:2267] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.573422 22465 master_service.cc:946] ReplaceTablet: received request to replace tablet c428b8f4aa1d45a8b04b64fc824dfe6c from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.573820 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 505606e672b7403b81e9af1d6d954b3f with delete_type TABLET_DATA_DELETED (replaced by tablet 5269be30c3f541c8a2531356e5f4fdc0) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.574020 23038 tablet_replica.cc:331] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.574163 23038 raft_consensus.cc:2238] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.574321 23038 raft_consensus.cc:2267] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.574647 23039 ts_tablet_manager.cc:1905] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.575042 23038 ts_tablet_manager.cc:1905] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.576365 23039 ts_tablet_manager.cc:1918] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:30.576475 23039 log.cc:1198] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/505606e672b7403b81e9af1d6d954b3f
I20250112 21:02:30.576699 23039 ts_tablet_manager.cc:1939] T 505606e672b7403b81e9af1d6d954b3f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.577212 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]) successfully deleted
I20250112 21:02:30.577428 23038 ts_tablet_manager.cc:1918] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:30.577562 23038 log.cc:1198] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/505606e672b7403b81e9af1d6d954b3f
I20250112 21:02:30.577840 23038 ts_tablet_manager.cc:1939] T 505606e672b7403b81e9af1d6d954b3f P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.578555 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]) successfully deleted
I20250112 21:02:30.579798 23040 ts_tablet_manager.cc:1918] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.579867 23040 log.cc:1198] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/96801602ee9d4ab7a19e1a46421b5f0d
I20250112 21:02:30.580050 23040 ts_tablet_manager.cc:1939] T 96801602ee9d4ab7a19e1a46421b5f0d P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.581007 22462 catalog_manager.cc:5526] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.581606 23119 raft_consensus.cc:491] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.581696 23119 raft_consensus.cc:513] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.582087 23119 leader_election.cc:290] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.582490 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76421422c8544991b9da0f53a4272cd1" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.582604 22762 tablet_service.cc:1467] Processing CreateTablet for tablet b3248b954b544c6abc850dda72aaee00 (DEFAULT_TABLE table=default.Table_d5adf7b63dfd4ab2bfac21301d6669e4 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.582860 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3248b954b544c6abc850dda72aaee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.582885 22758 tablet_service.cc:1467] Processing CreateTablet for tablet cfdd98834d4048e08c912c17bcb82674 (DEFAULT_TABLE table=default.Table_3efed8387f734f2896cc733cf475fe00 [id=db81d19c0a6348a2baea3faee4f65f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.583091 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdd98834d4048e08c912c17bcb82674. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.583429 22627 tablet_service.cc:1467] Processing CreateTablet for tablet cfdd98834d4048e08c912c17bcb82674 (DEFAULT_TABLE table=default.Table_3efed8387f734f2896cc733cf475fe00 [id=db81d19c0a6348a2baea3faee4f65f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.583637 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdd98834d4048e08c912c17bcb82674. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.582608 22781 raft_consensus.cc:2463] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.584903 23040 tablet_replica.cc:331] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.584997 22580 leader_election.cc:304] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.585196 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 96801602ee9d4ab7a19e1a46421b5f0d (table default.Table_53c56a74430245e5a2f5fdf757849d0d [id=2684b8498cea414a98b4471486f74b6d]) successfully deleted
I20250112 21:02:30.585376 22623 tablet_service.cc:1467] Processing CreateTablet for tablet b3248b954b544c6abc850dda72aaee00 (DEFAULT_TABLE table=default.Table_d5adf7b63dfd4ab2bfac21301d6669e4 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.585582 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3248b954b544c6abc850dda72aaee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.586952 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f90e77f194c947578af0716fc048db2a" } modify_external_catalogs: true
I20250112 21:02:30.587059 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f90e77f194c947578af0716fc048db2a" } modify_external_catalogs: true
I20250112 21:02:30.587287 22898 tablet_service.cc:1467] Processing CreateTablet for tablet b3248b954b544c6abc850dda72aaee00 (DEFAULT_TABLE table=default.Table_d5adf7b63dfd4ab2bfac21301d6669e4 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.587419 22895 tablet_service.cc:1467] Processing CreateTablet for tablet cfdd98834d4048e08c912c17bcb82674 (DEFAULT_TABLE table=default.Table_3efed8387f734f2896cc733cf475fe00 [id=db81d19c0a6348a2baea3faee4f65f61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.587510 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3248b954b544c6abc850dda72aaee00. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.587641 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdd98834d4048e08c912c17bcb82674. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.587864 23036 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.587934 23036 ts_tablet_manager.cc:1397] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250112 21:02:30.588356 23036 raft_consensus.cc:357] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.588469 23036 raft_consensus.cc:383] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.588501 23036 raft_consensus.cc:738] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.588618 23036 consensus_queue.cc:260] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.588862 23036 ts_tablet_manager.cc:1428] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.589023 23036 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.589438 23119 raft_consensus.cc:2798] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.589505 23119 raft_consensus.cc:491] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.589542 23119 raft_consensus.cc:3054] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.589913 23036 tablet_bootstrap.cc:654] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.590343 23119 raft_consensus.cc:513] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.590664 23119 leader_election.cc:290] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.591014 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76421422c8544991b9da0f53a4272cd1" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.591120 22781 raft_consensus.cc:3054] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.591972 22781 raft_consensus.cc:2463] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.592324 22580 leader_election.cc:304] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.592803 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76421422c8544991b9da0f53a4272cd1" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.593082 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76421422c8544991b9da0f53a4272cd1" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.593319 23034 tablet_bootstrap.cc:492] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.593402 23034 ts_tablet_manager.cc:1397] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.001s
W20250112 21:02:30.593546 22582 leader_election.cc:343] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:30.593786 22582 leader_election.cc:343] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.593842 23034 raft_consensus.cc:357] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.593924 23034 raft_consensus.cc:383] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.593961 23034 raft_consensus.cc:738] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.585018 23040 raft_consensus.cc:2238] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.594069 23034 consensus_queue.cc:260] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.594127 23040 raft_consensus.cc:2267] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.594321 23119 raft_consensus.cc:2798] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.594336 23034 ts_tablet_manager.cc:1428] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.594393 23119 raft_consensus.cc:695] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.594506 23034 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.594514 23119 consensus_queue.cc:237] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.595023 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet c428b8f4aa1d45a8b04b64fc824dfe6c
I20250112 21:02:30.595314 22465 catalog_manager.cc:6596] ReplaceTablet: tablet c428b8f4aa1d45a8b04b64fc824dfe6c deleted and replaced by tablet eb262c39bd5743b48fa8059170410d33
I20250112 21:02:30.595535 22459 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 76421422c8544991b9da0f53a4272cd1
I20250112 21:02:30.595547 23034 tablet_bootstrap.cc:654] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.595779 22459 catalog_manager.cc:6596] ReplaceTablet: tablet 76421422c8544991b9da0f53a4272cd1 deleted and replaced by tablet 287e9340b43a418791e5bcfe7e721720
I20250112 21:02:30.596303 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 87fda611fd0a4b3d91001ab926f74df0
I20250112 21:02:30.596596 22457 catalog_manager.cc:6596] ReplaceTablet: tablet 87fda611fd0a4b3d91001ab926f74df0 deleted and replaced by tablet 85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.596769 23034 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.596843 23034 ts_tablet_manager.cc:1397] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.596987 22466 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.597076 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c with delete_type TABLET_DATA_DELETED (replaced by tablet eb262c39bd5743b48fa8059170410d33) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.597237 22466 catalog_manager.cc:6596] ReplaceTablet: tablet 130ec7f6484644f1a36c01b3e9440b9b deleted and replaced by tablet e91583c8ab6447428a2b9fae7477dd4a
I20250112 21:02:30.597586 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 76421422c8544991b9da0f53a4272cd1 with delete_type TABLET_DATA_DELETED (replaced by tablet 287e9340b43a418791e5bcfe7e721720) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.597635 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 with delete_type TABLET_DATA_DELETED (replaced by tablet 85651379d0cf4c2dbf80a3702598f881) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.597702 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c with delete_type TABLET_DATA_DELETED (replaced by tablet eb262c39bd5743b48fa8059170410d33) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.597748 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b with delete_type TABLET_DATA_DELETED (replaced by tablet e91583c8ab6447428a2b9fae7477dd4a) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.597847 23038 tablet_replica.cc:331] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.597963 23038 raft_consensus.cc:2238] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.598054 23038 raft_consensus.cc:2267] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:30.598213 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 76421422c8544991b9da0f53a4272cd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76421422c8544991b9da0f53a4272cd1 already in progress: creating tablet
I20250112 21:02:30.598546 23038 ts_tablet_manager.cc:1905] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.599193 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 with delete_type TABLET_DATA_DELETED (replaced by tablet 85651379d0cf4c2dbf80a3702598f881) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.600239 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fda611fd0a4b3d91001ab926f74df0 with delete_type TABLET_DATA_DELETED (replaced by tablet 85651379d0cf4c2dbf80a3702598f881) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.600378 23038 ts_tablet_manager.cc:1918] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.600461 23038 log.cc:1198] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/87fda611fd0a4b3d91001ab926f74df0
I20250112 21:02:30.600646 23038 ts_tablet_manager.cc:1939] T 87fda611fd0a4b3d91001ab926f74df0 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.600926 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 38ab4d56670242c7ac1cfb180eabf3c5
I20250112 21:02:30.601233 23038 tablet_replica.cc:331] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.601336 23038 raft_consensus.cc:2238] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.601424 23038 raft_consensus.cc:2267] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.597549 23034 raft_consensus.cc:357] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.601523 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b with delete_type TABLET_DATA_DELETED (replaced by tablet e91583c8ab6447428a2b9fae7477dd4a) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.601579 23034 raft_consensus.cc:383] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.601632 23034 raft_consensus.cc:738] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.601728 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c with delete_type TABLET_DATA_DELETED (replaced by tablet eb262c39bd5743b48fa8059170410d33) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.601763 23034 consensus_queue.cc:260] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.602051 23038 ts_tablet_manager.cc:1905] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.602198 23034 ts_tablet_manager.cc:1428] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:30.602947 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 87fda611fd0a4b3d91001ab926f74df0 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
W20250112 21:02:30.603104 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet c428b8f4aa1d45a8b04b64fc824dfe6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c428b8f4aa1d45a8b04b64fc824dfe6c already in progress: creating tablet
I20250112 21:02:30.603220 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.603268 23040 ts_tablet_manager.cc:1905] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.603538 22464 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_f5d73d2eb66444888ba1c47a516b5da4 [id=83aa4d12b5d24a628351eb0a6b975cb7] alter complete (version 2)
I20250112 21:02:30.603618 23038 ts_tablet_manager.cc:1918] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.603670 23038 log.cc:1198] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.603930 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.604094 23038 ts_tablet_manager.cc:1939] T 130ec7f6484644f1a36c01b3e9440b9b P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.604655 23038 tablet_replica.cc:331] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.604763 23038 raft_consensus.cc:2238] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.604897 23038 pending_rounds.cc:62] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Trying to abort 1 pending ops.
I20250112 21:02:30.604934 23038 pending_rounds.cc:69] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714217463808 op_type: NO_OP noop_request { }
I20250112 21:02:30.604992 23038 raft_consensus.cc:2883] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.605046 23038 raft_consensus.cc:2267] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.605211 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.603883 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 38ab4d56670242c7ac1cfb180eabf3c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.604303 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 130ec7f6484644f1a36c01b3e9440b9b with delete_type TABLET_DATA_DELETED (replaced by tablet e91583c8ab6447428a2b9fae7477dd4a) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.605605 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 76421422c8544991b9da0f53a4272cd1 with delete_type TABLET_DATA_DELETED (replaced by tablet 287e9340b43a418791e5bcfe7e721720) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.602355 23034 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.607712 23034 tablet_bootstrap.cc:654] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.608512 23038 ts_tablet_manager.cc:1905] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.609053 23036 tablet_bootstrap.cc:492] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.609133 23036 ts_tablet_manager.cc:1397] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250112 21:02:30.609544 22461 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet eb262c39bd5743b48fa8059170410d33
I20250112 21:02:30.609614 23118 raft_consensus.cc:491] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.609685 23118 raft_consensus.cc:513] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.610015 23118 leader_election.cc:290] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.610199 23038 ts_tablet_manager.cc:1918] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.610271 23038 log.cc:1198] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/38ab4d56670242c7ac1cfb180eabf3c5
I20250112 21:02:30.610497 23038 ts_tablet_manager.cc:1939] T 38ab4d56670242c7ac1cfb180eabf3c5 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.610713 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130ec7f6484644f1a36c01b3e9440b9b" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.610821 22781 raft_consensus.cc:2463] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.609079 22466 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b] alter complete (version 1)
I20250112 21:02:30.611168 23040 ts_tablet_manager.cc:1918] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20250112 21:02:30.611241 22582 leader_election.cc:343] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: 130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.611337 23039 tablet_replica.cc:331] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.611379 22580 leader_election.cc:304] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.611457 23039 raft_consensus.cc:2238] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.611580 23039 pending_rounds.cc:62] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:30.611610 23039 pending_rounds.cc:69] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714166861824 op_type: NO_OP noop_request { }
I20250112 21:02:30.611658 23039 raft_consensus.cc:2883] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.611704 23039 raft_consensus.cc:2267] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.611763 23118 raft_consensus.cc:2798] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.611807 23118 raft_consensus.cc:491] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.611841 23118 raft_consensus.cc:3054] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.612277 23039 ts_tablet_manager.cc:1905] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.612707 23118 raft_consensus.cc:513] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.612998 23118 leader_election.cc:290] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.613207 23037 tablet_bootstrap.cc:492] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.613281 23037 ts_tablet_manager.cc:1397] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.000s
I20250112 21:02:30.613705 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "130ec7f6484644f1a36c01b3e9440b9b" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.613726 23037 raft_consensus.cc:357] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.613798 23037 raft_consensus.cc:383] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.613796 22781 raft_consensus.cc:3054] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.613818 23037 raft_consensus.cc:738] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.613905 23037 consensus_queue.cc:260] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.614069 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 76421422c8544991b9da0f53a4272cd1 with delete_type TABLET_DATA_DELETED (replaced by tablet 287e9340b43a418791e5bcfe7e721720) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.614125 23037 ts_tablet_manager.cc:1428] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.614279 23037 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.614619 22781 raft_consensus.cc:2463] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
W20250112 21:02:30.615000 22582 leader_election.cc:343] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: 130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.615118 22580 leader_election.cc:304] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.615147 23037 tablet_bootstrap.cc:654] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.615518 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 38ab4d56670242c7ac1cfb180eabf3c5 (table default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]) successfully deleted
I20250112 21:02:30.615690 23118 raft_consensus.cc:2798] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.615767 23118 raft_consensus.cc:695] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.615870 23118 consensus_queue.cc:237] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.616117 23034 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.616186 23034 ts_tablet_manager.cc:1397] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250112 21:02:30.616653 23034 raft_consensus.cc:357] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.616681 23036 raft_consensus.cc:357] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.616784 23036 raft_consensus.cc:383] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.616818 23036 raft_consensus.cc:738] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.616750 23034 raft_consensus.cc:383] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.616886 23034 raft_consensus.cc:738] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.616948 23036 consensus_queue.cc:260] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.617019 23034 consensus_queue.cc:260] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.617259 23036 ts_tablet_manager.cc:1428] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250112 21:02:30.617431 23036 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.617897 23034 ts_tablet_manager.cc:1428] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.618048 23034 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.618681 23036 tablet_bootstrap.cc:654] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.611240 23040 log.cc:1198] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/505606e672b7403b81e9af1d6d954b3f
I20250112 21:02:30.619390 23034 tablet_bootstrap.cc:654] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.619565 23040 ts_tablet_manager.cc:1939] T 505606e672b7403b81e9af1d6d954b3f P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.620456 23037 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.620488 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 505606e672b7403b81e9af1d6d954b3f (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]) successfully deleted
I20250112 21:02:30.620546 23037 ts_tablet_manager.cc:1397] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250112 21:02:30.620751 23040 tablet_replica.cc:331] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.620900 23040 raft_consensus.cc:2238] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.620945 23037 raft_consensus.cc:357] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.621085 23034 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.621088 23040 raft_consensus.cc:2267] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.621161 23034 ts_tablet_manager.cc:1397] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.621047 23037 raft_consensus.cc:383] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.621244 23037 raft_consensus.cc:738] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.621392 23037 consensus_queue.cc:260] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.621701 23040 ts_tablet_manager.cc:1905] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.622996 23037 ts_tablet_manager.cc:1428] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.623514 23040 ts_tablet_manager.cc:1918] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.623580 23040 log.cc:1198] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/87fda611fd0a4b3d91001ab926f74df0
I20250112 21:02:30.623762 23040 ts_tablet_manager.cc:1939] T 87fda611fd0a4b3d91001ab926f74df0 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.623855 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (DEFAULT_TABLE table=default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.624100 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebf8bb9004b41d7939a94acf2d2ef68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.624224 23034 raft_consensus.cc:357] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.624328 23034 raft_consensus.cc:383] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.624359 23034 raft_consensus.cc:738] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.624491 23034 consensus_queue.cc:260] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.624531 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 5269be30c3f541c8a2531356e5f4fdc0 (DEFAULT_TABLE table=default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.625598 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5269be30c3f541c8a2531356e5f4fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.624872 23034 ts_tablet_manager.cc:1428] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:30.626228 23034 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.626786 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (DEFAULT_TABLE table=default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.626812 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 5269be30c3f541c8a2531356e5f4fdc0 (DEFAULT_TABLE table=default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.627033 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebf8bb9004b41d7939a94acf2d2ef68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.628106 23034 tablet_bootstrap.cc:654] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.628130 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (DEFAULT_TABLE table=default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.628330 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ebf8bb9004b41d7939a94acf2d2ef68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.629041 23034 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.629118 23034 ts_tablet_manager.cc:1397] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250112 21:02:30.629423 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5269be30c3f541c8a2531356e5f4fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.629546 23034 raft_consensus.cc:357] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.629629 23034 raft_consensus.cc:383] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.629657 23034 raft_consensus.cc:738] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.629757 23034 consensus_queue.cc:260] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.629987 23034 ts_tablet_manager.cc:1428] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.630133 23034 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.630968 23034 tablet_bootstrap.cc:654] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.631162 23037 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.631625 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 5269be30c3f541c8a2531356e5f4fdc0 (DEFAULT_TABLE table=default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.631923 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5269be30c3f541c8a2531356e5f4fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.632469 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.634655 23036 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.634742 23036 ts_tablet_manager.cc:1397] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250112 21:02:30.635185 23036 raft_consensus.cc:357] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.635293 23036 raft_consensus.cc:383] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.635329 23036 raft_consensus.cc:738] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.635488 23036 consensus_queue.cc:260] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.636166 23037 tablet_bootstrap.cc:654] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.636216 23034 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.636302 23034 ts_tablet_manager.cc:1397] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250112 21:02:30.636735 23034 raft_consensus.cc:357] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.636829 23034 raft_consensus.cc:383] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.636862 23034 raft_consensus.cc:738] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.636965 23034 consensus_queue.cc:260] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.637136 23036 ts_tablet_manager.cc:1428] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.637229 23034 ts_tablet_manager.cc:1428] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.637413 23034 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.638233 23034 tablet_bootstrap.cc:654] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.638439 23036 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.639232 23037 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.639317 23037 ts_tablet_manager.cc:1397] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250112 21:02:30.639505 23036 tablet_bootstrap.cc:654] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.639777 23037 raft_consensus.cc:357] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.639878 23037 raft_consensus.cc:383] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.639909 23037 raft_consensus.cc:738] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.640010 23037 consensus_queue.cc:260] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.640293 23037 ts_tablet_manager.cc:1428] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.640937 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 287e9340b43a418791e5bcfe7e721720 (DEFAULT_TABLE table=default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.641155 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e9340b43a418791e5bcfe7e721720. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.641710 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 85651379d0cf4c2dbf80a3702598f881 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.641808 22626 tablet_service.cc:1467] Processing CreateTablet for tablet e91583c8ab6447428a2b9fae7477dd4a (DEFAULT_TABLE table=default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.641912 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85651379d0cf4c2dbf80a3702598f881. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.642006 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91583c8ab6447428a2b9fae7477dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.643152 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 85651379d0cf4c2dbf80a3702598f881 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.643343 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85651379d0cf4c2dbf80a3702598f881. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.643664 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 287e9340b43a418791e5bcfe7e721720 (DEFAULT_TABLE table=default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.643870 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e9340b43a418791e5bcfe7e721720. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.644424 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 85651379d0cf4c2dbf80a3702598f881 (DEFAULT_TABLE table=default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.644447 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 287e9340b43a418791e5bcfe7e721720 (DEFAULT_TABLE table=default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.644718 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85651379d0cf4c2dbf80a3702598f881. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.647364 23037 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.647670 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287e9340b43a418791e5bcfe7e721720. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.647887 23039 ts_tablet_manager.cc:1918] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.647948 23039 log.cc:1198] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/87fda611fd0a4b3d91001ab926f74df0
I20250112 21:02:30.648175 23039 ts_tablet_manager.cc:1939] T 87fda611fd0a4b3d91001ab926f74df0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.648284 23037 tablet_bootstrap.cc:654] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.648749 22762 tablet_service.cc:1467] Processing CreateTablet for tablet e91583c8ab6447428a2b9fae7477dd4a (DEFAULT_TABLE table=default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.648947 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91583c8ab6447428a2b9fae7477dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.649688 23039 tablet_replica.cc:331] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.649654 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 87fda611fd0a4b3d91001ab926f74df0 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
I20250112 21:02:30.649797 23039 raft_consensus.cc:2238] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.649881 23039 raft_consensus.cc:2267] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.650509 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 87fda611fd0a4b3d91001ab926f74df0 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
I20250112 21:02:30.650597 22896 tablet_service.cc:1467] Processing CreateTablet for tablet e91583c8ab6447428a2b9fae7477dd4a (DEFAULT_TABLE table=default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.650794 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 76421422c8544991b9da0f53a4272cd1 with delete_type TABLET_DATA_DELETED (replaced by tablet 287e9340b43a418791e5bcfe7e721720) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.650797 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91583c8ab6447428a2b9fae7477dd4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.651003 23038 tablet_replica.cc:331] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.651104 23039 ts_tablet_manager.cc:1905] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.651175 23038 raft_consensus.cc:2238] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.651330 23038 raft_consensus.cc:2267] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.651865 23040 tablet_replica.cc:331] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.651861 23038 ts_tablet_manager.cc:1905] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.651981 23040 raft_consensus.cc:2238] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.652009 23036 tablet_bootstrap.cc:492] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.652079 23036 ts_tablet_manager.cc:1397] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250112 21:02:30.652199 23040 pending_rounds.cc:62] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:30.652289 23040 pending_rounds.cc:69] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714523713536 op_type: NO_OP noop_request { }
I20250112 21:02:30.652356 23040 raft_consensus.cc:2883] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.652448 23040 raft_consensus.cc:2267] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.652567 23036 raft_consensus.cc:357] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.652670 23036 raft_consensus.cc:383] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.652706 23036 raft_consensus.cc:738] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.652849 23036 consensus_queue.cc:260] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.653096 23036 ts_tablet_manager.cc:1428] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.653736 23038 ts_tablet_manager.cc:1918] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.653818 23038 log.cc:1198] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/76421422c8544991b9da0f53a4272cd1
I20250112 21:02:30.653921 23039 ts_tablet_manager.cc:1918] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.653985 23039 log.cc:1198] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/38ab4d56670242c7ac1cfb180eabf3c5
I20250112 21:02:30.654003 23038 ts_tablet_manager.cc:1939] T 76421422c8544991b9da0f53a4272cd1 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.654170 23039 ts_tablet_manager.cc:1939] T 38ab4d56670242c7ac1cfb180eabf3c5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.654737 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 38ab4d56670242c7ac1cfb180eabf3c5 (table default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]) successfully deleted
W20250112 21:02:30.655275 23167 consensus_queue.cc:1159] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d8faec3969b64c33a4bf9aba509785ea" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250112 21:02:30.655740 23040 ts_tablet_manager.cc:1905] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.655974 23046 raft_consensus.cc:491] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.656039 23046 raft_consensus.cc:513] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.656327 23046 leader_election.cc:290] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.656770 23037 tablet_bootstrap.cc:492] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.656847 23037 ts_tablet_manager.cc:1397] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20250112 21:02:30.656991 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdeb12d12d3244dbac58127ebeb662cd" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.657099 22781 raft_consensus.cc:2463] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.657263 23037 raft_consensus.cc:357] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.657361 23037 raft_consensus.cc:383] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.657393 23037 raft_consensus.cc:738] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.657464 22851 leader_election.cc:304] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.657503 23037 consensus_queue.cc:260] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.657671 23040 ts_tablet_manager.cc:1918] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.657735 23040 log.cc:1198] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.657758 23037 ts_tablet_manager.cc:1428] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.657929 23037 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.657943 23040 ts_tablet_manager.cc:1939] T 130ec7f6484644f1a36c01b3e9440b9b P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.658305 23046 raft_consensus.cc:2798] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.658355 23046 raft_consensus.cc:491] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.658389 23046 raft_consensus.cc:3054] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.658833 23037 tablet_bootstrap.cc:654] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.659217 23046 raft_consensus.cc:513] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.659479 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdeb12d12d3244dbac58127ebeb662cd" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.659571 23046 leader_election.cc:290] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.659602 22646 raft_consensus.cc:2463] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.659655 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.660534 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdeb12d12d3244dbac58127ebeb662cd" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.661103 22781 raft_consensus.cc:3054] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.661391 23040 tablet_replica.cc:331] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.661435 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdeb12d12d3244dbac58127ebeb662cd" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.661566 22646 raft_consensus.cc:3054] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.661613 23039 tablet_replica.cc:331] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.661710 23039 raft_consensus.cc:2238] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.661790 23039 raft_consensus.cc:2267] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.662215 23039 ts_tablet_manager.cc:1905] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.662246 22781 raft_consensus.cc:2463] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.662434 22646 raft_consensus.cc:2463] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.662518 22851 leader_election.cc:304] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.662868 23046 raft_consensus.cc:2798] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.662958 23046 raft_consensus.cc:695] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:30.663081 23046 consensus_queue.cc:237] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.663957 23039 ts_tablet_manager.cc:1918] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.664031 23039 log.cc:1198] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/130ec7f6484644f1a36c01b3e9440b9b
I20250112 21:02:30.664233 23039 ts_tablet_manager.cc:1939] T 130ec7f6484644f1a36c01b3e9440b9b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.664891 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 130ec7f6484644f1a36c01b3e9440b9b (table default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.664986 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 76421422c8544991b9da0f53a4272cd1 (table default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
I20250112 21:02:30.665220 23039 tablet_replica.cc:331] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.665321 23039 raft_consensus.cc:2238] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.665403 23039 raft_consensus.cc:2267] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.665315 22466 catalog_manager.cc:5526] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.668509 23036 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.669479 23036 tablet_bootstrap.cc:654] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.661489 23040 raft_consensus.cc:2238] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.670120 23040 raft_consensus.cc:2267] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.671103 23037 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.671128 23034 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.671188 23034 ts_tablet_manager.cc:1397] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.002s
I20250112 21:02:30.671190 23037 ts_tablet_manager.cc:1397] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20250112 21:02:30.671149 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_33cdf1c64ca5419281df3d5863803dca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.671526 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33cdf1c64ca5419281df3d5863803dca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.671628 23034 raft_consensus.cc:357] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.671630 23037 raft_consensus.cc:357] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.671720 23037 raft_consensus.cc:383] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.671720 23034 raft_consensus.cc:383] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.671751 23037 raft_consensus.cc:738] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.671751 23034 raft_consensus.cc:738] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.671864 23034 consensus_queue.cc:260] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.671864 23037 consensus_queue.cc:260] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.672106 23034 ts_tablet_manager.cc:1428] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.672106 23037 ts_tablet_manager.cc:1428] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.672271 23037 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.672279 23034 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.673189 23034 tablet_bootstrap.cc:654] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.673229 23037 tablet_bootstrap.cc:654] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.675017 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_60f17231f22844be8035401f830c0758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.675330 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60f17231f22844be8035401f830c0758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.675985 23040 ts_tablet_manager.cc:1905] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.676767 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_bb4c46b3766b4fdcac393f9680d45141"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.677050 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb4c46b3766b4fdcac393f9680d45141 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.678241 23040 ts_tablet_manager.cc:1918] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.678313 23040 log.cc:1198] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/c428b8f4aa1d45a8b04b64fc824dfe6c
I20250112 21:02:30.678495 23040 ts_tablet_manager.cc:1939] T c428b8f4aa1d45a8b04b64fc824dfe6c P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.680691 23041 raft_consensus.cc:491] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.680747 23036 tablet_bootstrap.cc:492] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.680778 23041 raft_consensus.cc:513] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.681102 23036 ts_tablet_manager.cc:1397] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.000s
I20250112 21:02:30.681115 23041 leader_election.cc:290] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:30.681594 23040 tablet_replica.cc:331] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.681712 23040 raft_consensus.cc:2238] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.681726 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdd98834d4048e08c912c17bcb82674" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.681808 23040 raft_consensus.cc:2267] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.681710 23036 raft_consensus.cc:357] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.681850 23036 raft_consensus.cc:383] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.681841 22646 raft_consensus.cc:2463] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.681885 23036 raft_consensus.cc:738] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.682017 23036 consensus_queue.cc:260] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.682144 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdd98834d4048e08c912c17bcb82674" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.682263 23036 ts_tablet_manager.cc:1428] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.682431 23036 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.682561 23040 ts_tablet_manager.cc:1905] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:30.683377 22717 leader_election.cc:343] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.683687 22715 leader_election.cc:304] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.683849 23041 raft_consensus.cc:2798] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.683903 23041 raft_consensus.cc:491] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.683938 23041 raft_consensus.cc:3054] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.684146 23036 tablet_bootstrap.cc:654] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.684826 23041 raft_consensus.cc:513] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.685127 23036 tablet_bootstrap.cc:492] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.685159 23041 leader_election.cc:290] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:30.685215 23036 ts_tablet_manager.cc:1397] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250112 21:02:30.685658 23036 raft_consensus.cc:357] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.685724 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdd98834d4048e08c912c17bcb82674" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.685772 23036 raft_consensus.cc:383] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.685801 23036 raft_consensus.cc:738] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.685912 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfdd98834d4048e08c912c17bcb82674" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.685911 23036 consensus_queue.cc:260] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.686004 22646 raft_consensus.cc:3054] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.686152 23036 ts_tablet_manager.cc:1428] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.686354 23036 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.686836 22646 raft_consensus.cc:2463] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.687295 23036 tablet_bootstrap.cc:654] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.687356 22715 leader_election.cc:304] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.687563 22916 raft_consensus.cc:3054] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.688449 22916 raft_consensus.cc:2463] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.689085 23041 raft_consensus.cc:2798] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.689168 23041 raft_consensus.cc:695] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.689285 23041 consensus_queue.cc:237] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.690768 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet c428b8f4aa1d45a8b04b64fc824dfe6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.690961 23038 tablet_replica.cc:331] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.691100 23038 raft_consensus.cc:2238] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.691197 23038 raft_consensus.cc:2267] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.691594 23038 ts_tablet_manager.cc:1905] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.692104 23034 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.692194 23034 ts_tablet_manager.cc:1397] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20250112 21:02:30.692678 23034 raft_consensus.cc:357] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.692777 23034 raft_consensus.cc:383] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.692812 23034 raft_consensus.cc:738] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.692919 23034 consensus_queue.cc:260] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.693156 23036 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.693177 23034 ts_tablet_manager.cc:1428] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.693222 23036 ts_tablet_manager.cc:1397] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:30.693384 23034 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.693645 23038 ts_tablet_manager.cc:1918] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.693704 23038 log.cc:1198] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/c428b8f4aa1d45a8b04b64fc824dfe6c
I20250112 21:02:30.693670 23036 raft_consensus.cc:357] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.693763 23036 raft_consensus.cc:383] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.693794 23036 raft_consensus.cc:738] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.693884 23038 ts_tablet_manager.cc:1939] T c428b8f4aa1d45a8b04b64fc824dfe6c P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.693902 23036 consensus_queue.cc:260] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.694125 23036 ts_tablet_manager.cc:1428] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.694283 23034 tablet_bootstrap.cc:654] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.694311 23036 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.695154 23036 tablet_bootstrap.cc:654] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.695958 23037 tablet_bootstrap.cc:492] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.696038 23037 ts_tablet_manager.cc:1397] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250112 21:02:30.696496 23037 raft_consensus.cc:357] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.696604 23037 raft_consensus.cc:383] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.696640 23037 raft_consensus.cc:738] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.696748 23037 consensus_queue.cc:260] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.696998 23037 ts_tablet_manager.cc:1428] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.697172 23037 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.698081 23037 tablet_bootstrap.cc:654] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.698681 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet c428b8f4aa1d45a8b04b64fc824dfe6c (table default.Table_f90e77f194c947578af0716fc048db2a [id=22d0a7749b274fcba077dd05309c7c93]) successfully deleted
I20250112 21:02:30.699007 23037 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.699134 23037 ts_tablet_manager.cc:1397] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.699625 23037 raft_consensus.cc:357] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.699774 23037 raft_consensus.cc:383] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.699846 23037 raft_consensus.cc:738] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.700019 23037 consensus_queue.cc:260] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.700343 23037 ts_tablet_manager.cc:1428] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.700574 23037 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.701900 23037 tablet_bootstrap.cc:654] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.702872 23037 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.702951 23037 ts_tablet_manager.cc:1397] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:30.703132 23040 ts_tablet_manager.cc:1918] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.703186 23040 log.cc:1198] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/38ab4d56670242c7ac1cfb180eabf3c5
I20250112 21:02:30.703366 23040 ts_tablet_manager.cc:1939] T 38ab4d56670242c7ac1cfb180eabf3c5 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.703353 23037 raft_consensus.cc:357] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.703557 23037 raft_consensus.cc:383] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.703599 23037 raft_consensus.cc:738] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.703716 23037 consensus_queue.cc:260] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.703963 23037 ts_tablet_manager.cc:1428] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.704133 23037 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.704105 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 38ab4d56670242c7ac1cfb180eabf3c5 (table default.Table_a200ec004be44c6eacd33f76133ab58e [id=62d4c4cb0467416890f70af3da57d102]) successfully deleted
I20250112 21:02:30.705125 23037 tablet_bootstrap.cc:654] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.705622 23040 tablet_replica.cc:331] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.705623 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 2 got 0
I20250112 21:02:30.705746 23040 raft_consensus.cc:2238] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.705868 23040 pending_rounds.cc:62] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:30.705893 23040 pending_rounds.cc:69] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714436243456 op_type: NO_OP noop_request { }
W20250112 21:02:30.705895 22466 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5269be30c3f541c8a2531356e5f4fdc0 consensus state has no leader
I20250112 21:02:30.705937 23040 raft_consensus.cc:2883] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.705983 23040 raft_consensus.cc:2267] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.706503 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_3f2f0eca127a4bb4abf251b5f3947f61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.706760 23037 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.706826 23037 ts_tablet_manager.cc:1397] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
W20250112 21:02:30.706852 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f2f0eca127a4bb4abf251b5f3947f61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.707232 23037 raft_consensus.cc:357] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.707329 23037 raft_consensus.cc:383] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.707361 23037 raft_consensus.cc:738] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.707459 23037 consensus_queue.cc:260] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.707684 23037 ts_tablet_manager.cc:1428] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.707842 23037 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.708719 23037 tablet_bootstrap.cc:654] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.709563 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 2 got 0
I20250112 21:02:30.709625 23036 tablet_bootstrap.cc:492] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.709699 23036 ts_tablet_manager.cc:1397] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250112 21:02:30.710131 23036 raft_consensus.cc:357] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.710235 23036 raft_consensus.cc:383] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.710280 23036 raft_consensus.cc:738] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.710391 23036 consensus_queue.cc:260] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.710638 23036 ts_tablet_manager.cc:1428] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.710825 23036 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.711311 23040 ts_tablet_manager.cc:1905] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.711575 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 1 got 0
I20250112 21:02:30.711663 23036 tablet_bootstrap.cc:654] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.712785 22460 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 287e9340b43a418791e5bcfe7e721720 consensus state has no leader
I20250112 21:02:30.714229 22461 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 1 got 0
I20250112 21:02:30.714784 23040 ts_tablet_manager.cc:1918] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.714854 23040 log.cc:1198] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/76421422c8544991b9da0f53a4272cd1
I20250112 21:02:30.715070 23040 ts_tablet_manager.cc:1939] T 76421422c8544991b9da0f53a4272cd1 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.716140 23036 tablet_bootstrap.cc:492] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.716166 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 76421422c8544991b9da0f53a4272cd1 (table default.Table_3a97ce8861b64293baf4aaac6a4d79e5 [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
I20250112 21:02:30.716225 23036 ts_tablet_manager.cc:1397] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20250112 21:02:30.716660 23036 raft_consensus.cc:357] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.716773 23036 raft_consensus.cc:383] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.716809 23036 raft_consensus.cc:738] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.716943 23036 consensus_queue.cc:260] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.717507 23037 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.717588 23037 ts_tablet_manager.cc:1397] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250112 21:02:30.717983 23037 raft_consensus.cc:357] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.718081 23037 raft_consensus.cc:383] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.718112 23037 raft_consensus.cc:738] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.718252 23036 ts_tablet_manager.cc:1428] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250112 21:02:30.718218 23037 consensus_queue.cc:260] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.718463 23037 ts_tablet_manager.cc:1428] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.718644 23037 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.719388 22466 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_cc2500d1fd764e0287ac184ef9039be4 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 2 got 0
I20250112 21:02:30.719535 23037 tablet_bootstrap.cc:654] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.719839 23036 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.720922 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3a97ce8861b64293baf4aaac6a4d79e5" } new_table_name: "default.Table_c3f61b92787e402a9c6c937605d353cb" modify_external_catalogs: true
I20250112 21:02:30.721007 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_dae5a0b928c6449aa03e5b001b10a2cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.721292 23036 tablet_bootstrap.cc:654] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.721338 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dae5a0b928c6449aa03e5b001b10a2cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.722851 23036 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.722936 23036 ts_tablet_manager.cc:1397] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.723434 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_cc2500d1fd764e0287ac184ef9039be4" } new_table_name: "default.Table_b0c1845fae724ad2b951fc8c1909b011" modify_external_catalogs: true
I20250112 21:02:30.723461 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_02d4dc14615749259db8519e1657df57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.723496 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_709d0765a8bd447c92f9280f7ac23d67" } new_table_name: "default.Table_b940e6b6c4df4f7d841f68157ae30700" modify_external_catalogs: true
W20250112 21:02:30.723779 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d4dc14615749259db8519e1657df57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.723312 23036 raft_consensus.cc:357] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.724364 23036 raft_consensus.cc:383] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.724431 23036 raft_consensus.cc:738] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.724560 23036 consensus_queue.cc:260] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.724819 23036 ts_tablet_manager.cc:1428] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.724989 23036 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.725605 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_2b2108fc20e24a15a3b59949ac8a256c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.725914 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b2108fc20e24a15a3b59949ac8a256c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.727370 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f190315f79014ff7b36f19c8a586e1f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.727648 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f190315f79014ff7b36f19c8a586e1f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.725639 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8d5adb649f2d4ea19c4c5e605bc2aa66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.728199 23065 raft_consensus.cc:491] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.728297 23065 raft_consensus.cc:513] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
W20250112 21:02:30.728382 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d5adb649f2d4ea19c4c5e605bc2aa66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.728775 23065 leader_election.cc:290] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.729164 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebf8bb9004b41d7939a94acf2d2ef68" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.729286 22916 raft_consensus.cc:2463] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.729712 22717 leader_election.cc:304] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.729748 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebf8bb9004b41d7939a94acf2d2ef68" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.729873 23065 raft_consensus.cc:2798] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.729866 22646 raft_consensus.cc:2463] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.729912 23065 raft_consensus.cc:491] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.729943 23065 raft_consensus.cc:3054] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.730638 23036 tablet_bootstrap.cc:654] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.730958 23065 raft_consensus.cc:513] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
W20250112 21:02:30.731345 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 287e9340b43a418791e5bcfe7e721720 consensus state has no leader
I20250112 21:02:30.731590 23065 leader_election.cc:290] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.731825 23036 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.731899 23036 ts_tablet_manager.cc:1397] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250112 21:02:30.731940 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebf8bb9004b41d7939a94acf2d2ef68" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.732030 22916 raft_consensus.cc:3054] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.732317 23036 raft_consensus.cc:357] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.732437 23036 raft_consensus.cc:383] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.732468 23036 raft_consensus.cc:738] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.732575 23036 consensus_queue.cc:260] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
W20250112 21:02:30.732708 22457 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5269be30c3f541c8a2531356e5f4fdc0 consensus state has no leader
I20250112 21:02:30.732824 23036 ts_tablet_manager.cc:1428] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.732949 22916 raft_consensus.cc:2463] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.732997 23036 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.733852 23036 tablet_bootstrap.cc:654] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.734335 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 2 got 0
I20250112 21:02:30.735153 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebf8bb9004b41d7939a94acf2d2ef68" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.735284 22646 raft_consensus.cc:3054] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.736232 22646 raft_consensus.cc:2463] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.736332 23036 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.736418 23036 ts_tablet_manager.cc:1397] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.736835 23036 raft_consensus.cc:357] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.736929 23036 raft_consensus.cc:383] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.736919 22715 leader_election.cc:304] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.736958 23036 raft_consensus.cc:738] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.737075 23065 raft_consensus.cc:2798] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.737087 23036 consensus_queue.cc:260] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.737143 23065 raft_consensus.cc:695] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.737262 23065 consensus_queue.cc:237] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.737341 23036 ts_tablet_manager.cc:1428] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.740756 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3f2f0eca127a4bb4abf251b5f3947f61" } modify_external_catalogs: true
I20250112 21:02:30.740792 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_dae5a0b928c6449aa03e5b001b10a2cd" } new_table_name: "default.Table_9ab2546cb10f4ef98142d1ba7f737471" modify_external_catalogs: true
I20250112 21:02:30.740880 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3f2f0eca127a4bb4abf251b5f3947f61" } modify_external_catalogs: true
I20250112 21:02:30.743122 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 3 got 0
I20250112 21:02:30.743145 22464 catalog_manager.cc:5526] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.744163 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 2 got 0
I20250112 21:02:30.744275 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_709d0765a8bd447c92f9280f7ac23d67 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 3 got 0
W20250112 21:02:30.744468 22462 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e91583c8ab6447428a2b9fae7477dd4a consensus state has no leader
I20250112 21:02:30.746167 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.746461 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.746850 22457 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7184be0d13f14b1083f192eac5b46351
W20250112 21:02:30.747152 22461 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71c22a901e6c4348a9b0e79598a93cae has no consensus state
I20250112 21:02:30.748941 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 0cca9c24edcd4c899be46abea69505d5 (DEFAULT_TABLE table=default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.749187 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cca9c24edcd4c899be46abea69505d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.751941 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 0cca9c24edcd4c899be46abea69505d5 (DEFAULT_TABLE table=default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.752187 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cca9c24edcd4c899be46abea69505d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.754077 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 3 got 0
I20250112 21:02:30.754130 23036 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.754175 22464 catalog_manager.cc:5526] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.755550 23036 tablet_bootstrap.cc:654] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.756003 23039 ts_tablet_manager.cc:1905] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.757048 22627 tablet_service.cc:1467] Processing CreateTablet for tablet a3a1f99179b94df3a621c8cfa07782fa (DEFAULT_TABLE table=default.Table_33cdf1c64ca5419281df3d5863803dca [id=512a050d504741948e1bc718ac07ef87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.757287 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a1f99179b94df3a621c8cfa07782fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.757406 23036 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.757488 23036 ts_tablet_manager.cc:1397] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20250112 21:02:30.757898 23036 raft_consensus.cc:357] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.757989 23036 raft_consensus.cc:383] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.758016 23036 raft_consensus.cc:738] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.758145 23036 consensus_queue.cc:260] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.758423 23036 ts_tablet_manager.cc:1428] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.759618 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c" } modify_external_catalogs: true
I20250112 21:02:30.759680 22457 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_64fb8ef7b3f643399a091c234bcd8e67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.759727 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c" } modify_external_catalogs: true
W20250112 21:02:30.759994 22457 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64fb8ef7b3f643399a091c234bcd8e67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.756668 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 0cca9c24edcd4c899be46abea69505d5 (DEFAULT_TABLE table=default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.762519 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cca9c24edcd4c899be46abea69505d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.763847 22896 tablet_service.cc:1467] Processing CreateTablet for tablet a3a1f99179b94df3a621c8cfa07782fa (DEFAULT_TABLE table=default.Table_33cdf1c64ca5419281df3d5863803dca [id=512a050d504741948e1bc718ac07ef87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.764092 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a1f99179b94df3a621c8cfa07782fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.766166 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.766764 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 85651379d0cf4c2dbf80a3702598f881 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.767161 23036 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:30.767271 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 85651379d0cf4c2dbf80a3702598f881 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85651379d0cf4c2dbf80a3702598f881 already in progress: creating tablet
I20250112 21:02:30.767462 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 85651379d0cf4c2dbf80a3702598f881 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.767608 23038 tablet_replica.cc:331] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.767712 23038 raft_consensus.cc:2238] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.767804 23038 raft_consensus.cc:2267] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.767887 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 85651379d0cf4c2dbf80a3702598f881 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.768160 23036 tablet_bootstrap.cc:654] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.768285 23038 ts_tablet_manager.cc:1905] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.769610 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f3a29e661dd34f458c8ebeeaf8a33b68" } modify_external_catalogs: true
I20250112 21:02:30.769711 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f3a29e661dd34f458c8ebeeaf8a33b68" } modify_external_catalogs: true
I20250112 21:02:30.770215 23038 ts_tablet_manager.cc:1918] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.770287 23038 log.cc:1198] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.770493 23038 ts_tablet_manager.cc:1939] T 85651379d0cf4c2dbf80a3702598f881 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.770656 22762 tablet_service.cc:1467] Processing CreateTablet for tablet a3a1f99179b94df3a621c8cfa07782fa (DEFAULT_TABLE table=default.Table_33cdf1c64ca5419281df3d5863803dca [id=512a050d504741948e1bc718ac07ef87]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.770895 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a1f99179b94df3a621c8cfa07782fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.773074 23034 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.773176 23034 ts_tablet_manager.cc:1397] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.000s
I20250112 21:02:30.773216 23037 tablet_bootstrap.cc:492] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.773310 23037 ts_tablet_manager.cc:1397] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250112 21:02:30.773699 23034 raft_consensus.cc:357] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.773798 23034 raft_consensus.cc:383] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.773828 23034 raft_consensus.cc:738] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.773880 23037 raft_consensus.cc:357] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.773936 23034 consensus_queue.cc:260] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.773980 23037 raft_consensus.cc:383] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.774010 23037 raft_consensus.cc:738] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.774127 23037 consensus_queue.cc:260] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.774204 23034 ts_tablet_manager.cc:1428] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.774385 23037 ts_tablet_manager.cc:1428] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.774399 23034 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.774560 23037 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.775188 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_2b2108fc20e24a15a3b59949ac8a256c" } new_table_name: "default.Table_29611f22fb9a4713a93adb161ea7f4fb" modify_external_catalogs: true
I20250112 21:02:30.775321 23034 tablet_bootstrap.cc:654] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.775492 23037 tablet_bootstrap.cc:654] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.776386 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 85651379d0cf4c2dbf80a3702598f881 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
I20250112 21:02:30.778887 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 2b359497fc5d4d028c36b588410bf399 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.779094 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b359497fc5d4d028c36b588410bf399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.780121 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 2b359497fc5d4d028c36b588410bf399 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.780391 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b359497fc5d4d028c36b588410bf399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.782970 22458 master_service.cc:946] ReplaceTablet: received request to replace tablet 0644eab03d36474cbe6f363d15e36e73 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.783430 23034 tablet_bootstrap.cc:492] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.783524 23034 ts_tablet_manager.cc:1397] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250112 21:02:30.783982 23034 raft_consensus.cc:357] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.784080 23034 raft_consensus.cc:383] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.784113 23034 raft_consensus.cc:738] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.784056 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 2b359497fc5d4d028c36b588410bf399 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.784224 23034 consensus_queue.cc:260] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.784324 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b359497fc5d4d028c36b588410bf399. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.784565 23034 ts_tablet_manager.cc:1428] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.784726 23034 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.785641 23034 tablet_bootstrap.cc:654] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.786825 22461 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd45bb2c57a74ace9e09e89ee09cee30 has no consensus state
I20250112 21:02:30.787587 23037 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.787671 23037 ts_tablet_manager.cc:1397] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250112 21:02:30.788134 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0ebf8bb9004b41d7939a94acf2d2ef68
I20250112 21:02:30.788122 23037 raft_consensus.cc:357] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.788219 23037 raft_consensus.cc:383] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.788254 23037 raft_consensus.cc:738] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.788579 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 85651379d0cf4c2dbf80a3702598f881 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.788695 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.788741 23040 tablet_replica.cc:331] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.788765 23037 consensus_queue.cc:260] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.788852 23040 raft_consensus.cc:2238] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.788959 23040 raft_consensus.cc:2267] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.789037 23037 ts_tablet_manager.cc:1428] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.789479 23037 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.790251 22461 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 2 got 0
I20250112 21:02:30.790421 23037 tablet_bootstrap.cc:654] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.791558 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.791769 23037 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.791852 23037 ts_tablet_manager.cc:1397] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.792279 23037 raft_consensus.cc:357] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.792393 23037 raft_consensus.cc:383] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.792449 23037 raft_consensus.cc:738] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.792586 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0644eab03d36474cbe6f363d15e36e73
I20250112 21:02:30.792580 23037 consensus_queue.cc:260] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.792811 23037 ts_tablet_manager.cc:1428] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.792831 22458 catalog_manager.cc:6596] ReplaceTablet: tablet 0644eab03d36474cbe6f363d15e36e73 deleted and replaced by tablet 159ed04aaf0447ad9b016d39f3271aaf
I20250112 21:02:30.792976 23037 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.793896 23041 raft_consensus.cc:491] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.793975 23041 raft_consensus.cc:513] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.794339 23041 leader_election.cc:290] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.795120 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebf8bb9004b41d7939a94acf2d2ef68 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.795367 23038 tablet_replica.cc:331] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.795495 23038 raft_consensus.cc:2238] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.795589 23038 raft_consensus.cc:2267] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.794878 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85651379d0cf4c2dbf80a3702598f881" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:30.796303 22715 leader_election.cc:343] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.793850 23037 tablet_bootstrap.cc:654] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.796550 23038 ts_tablet_manager.cc:1905] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.797114 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 0644eab03d36474cbe6f363d15e36e73 with delete_type TABLET_DATA_DELETED (replaced by tablet 159ed04aaf0447ad9b016d39f3271aaf) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.797238 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 0644eab03d36474cbe6f363d15e36e73 with delete_type TABLET_DATA_DELETED (replaced by tablet 159ed04aaf0447ad9b016d39f3271aaf) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.797673 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 0644eab03d36474cbe6f363d15e36e73 with delete_type TABLET_DATA_DELETED (replaced by tablet 159ed04aaf0447ad9b016d39f3271aaf) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.797991 23039 ts_tablet_manager.cc:1918] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.798035 23039 log.cc:1198] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/76421422c8544991b9da0f53a4272cd1
I20250112 21:02:30.798175 23039 ts_tablet_manager.cc:1939] T 76421422c8544991b9da0f53a4272cd1 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.798609 23038 ts_tablet_manager.cc:1918] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.798668 23038 log.cc:1198] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/0ebf8bb9004b41d7939a94acf2d2ef68
I20250112 21:02:30.798841 23038 ts_tablet_manager.cc:1939] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.799289 23039 tablet_replica.cc:331] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.799362 23038 tablet_replica.cc:331] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.799404 23039 raft_consensus.cc:2238] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.799474 23038 raft_consensus.cc:2238] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.799497 23039 raft_consensus.cc:2267] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.799563 23038 raft_consensus.cc:2267] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.801056 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (table default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]) successfully deleted
W20250112 21:02:30.801234 22717 leader_election.cc:343] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: 85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.801317 22717 leader_election.cc:304] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:30.801344 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 76421422c8544991b9da0f53a4272cd1 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
I20250112 21:02:30.801549 23034 tablet_bootstrap.cc:492] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.801630 23034 ts_tablet_manager.cc:1397] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250112 21:02:30.802037 23034 raft_consensus.cc:357] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.802134 23034 raft_consensus.cc:383] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.802162 23034 raft_consensus.cc:738] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.802277 23034 consensus_queue.cc:260] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.802522 23034 ts_tablet_manager.cc:1428] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.802610 23041 raft_consensus.cc:2743] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:30.802721 23034 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.802870 23038 ts_tablet_manager.cc:1905] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.803611 23034 tablet_bootstrap.cc:654] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.804840 23038 ts_tablet_manager.cc:1918] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.804953 23038 log.cc:1198] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/0644eab03d36474cbe6f363d15e36e73
I20250112 21:02:30.805195 23038 ts_tablet_manager.cc:1939] T 0644eab03d36474cbe6f363d15e36e73 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.805992 23034 tablet_bootstrap.cc:492] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.806075 23034 ts_tablet_manager.cc:1397] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:30.806311 22464 master_service.cc:946] ReplaceTablet: received request to replace tablet 76421422c8544991b9da0f53a4272cd1 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.806531 22461 master_service.cc:946] ReplaceTablet: received request to replace tablet 833b963c15c94c40b685b841defeec4f from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.806557 22459 master_service.cc:946] ReplaceTablet: received request to replace tablet 42f011ccfe3741a09e48c51464f658ec from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.806495 22460 master_service.cc:946] ReplaceTablet: received request to replace tablet a3a1f99179b94df3a621c8cfa07782fa from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:30.806501 22462 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_33cdf1c64ca5419281df3d5863803dca" } modify_external_catalogs: true
I20250112 21:02:30.806828 22462 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_33cdf1c64ca5419281df3d5863803dca" } modify_external_catalogs: true
I20250112 21:02:30.806941 23034 raft_consensus.cc:357] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.807036 23034 raft_consensus.cc:383] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.807085 23034 raft_consensus.cc:738] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.807222 23034 consensus_queue.cc:260] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.807499 23034 ts_tablet_manager.cc:1428] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.807718 23034 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.808606 23040 ts_tablet_manager.cc:1905] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.808733 23034 tablet_bootstrap.cc:654] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.809825 23125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250112 21:02:30.810142 23125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250112 21:02:30.810240 23125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250112 21:02:30.810688 23040 ts_tablet_manager.cc:1918] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.810674 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 0644eab03d36474cbe6f363d15e36e73 (table default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:30.810760 23040 log.cc:1198] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.811249 23040 ts_tablet_manager.cc:1939] T 85651379d0cf4c2dbf80a3702598f881 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.811378 22464 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_60f17231f22844be8035401f830c0758" } modify_external_catalogs: true
I20250112 21:02:30.811491 22464 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_60f17231f22844be8035401f830c0758" } modify_external_catalogs: true
I20250112 21:02:30.811841 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 85651379d0cf4c2dbf80a3702598f881 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
I20250112 21:02:30.812489 23040 tablet_replica.cc:331] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.812613 23040 raft_consensus.cc:2238] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.812708 23040 raft_consensus.cc:2267] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.812920 23118 raft_consensus.cc:491] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.813022 23118 raft_consensus.cc:513] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.813148 23040 ts_tablet_manager.cc:1905] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.813380 23118 leader_election.cc:290] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.813624 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3248b954b544c6abc850dda72aaee00" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.813733 22916 raft_consensus.cc:2463] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.813762 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3248b954b544c6abc850dda72aaee00" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.813868 22781 raft_consensus.cc:2463] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.813988 22582 leader_election.cc:304] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.814139 23118 raft_consensus.cc:2798] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.814172 23118 raft_consensus.cc:491] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.814204 23118 raft_consensus.cc:3054] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.814999 23118 raft_consensus.cc:513] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.815330 23118 leader_election.cc:290] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.815539 23034 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.815611 23034 ts_tablet_manager.cc:1397] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250112 21:02:30.815676 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3248b954b544c6abc850dda72aaee00" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.815779 22781 raft_consensus.cc:3054] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.816006 23034 raft_consensus.cc:357] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.816087 23034 raft_consensus.cc:383] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.816115 23034 raft_consensus.cc:738] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.816236 23034 consensus_queue.cc:260] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.816501 23034 ts_tablet_manager.cc:1428] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.816632 22781 raft_consensus.cc:2463] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.817049 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3248b954b544c6abc850dda72aaee00" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.817143 22916 raft_consensus.cc:3054] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.817934 22916 raft_consensus.cc:2463] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.818215 22580 leader_election.cc:304] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.818605 23037 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.818688 23037 ts_tablet_manager.cc:1397] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
I20250112 21:02:30.819113 23037 raft_consensus.cc:357] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.819195 23118 raft_consensus.cc:2798] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.819209 23037 raft_consensus.cc:383] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.819269 23037 raft_consensus.cc:738] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.819293 23118 raft_consensus.cc:695] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.819379 23037 consensus_queue.cc:260] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.819396 23118 consensus_queue.cc:237] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.819680 23037 ts_tablet_manager.cc:1428] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.816653 23034 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.821558 23034 tablet_bootstrap.cc:654] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.823714 23134 raft_consensus.cc:491] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.823799 23134 raft_consensus.cc:513] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.824126 23134 leader_election.cc:290] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.824549 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91583c8ab6447428a2b9fae7477dd4a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.824654 22646 raft_consensus.cc:2463] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.824815 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91583c8ab6447428a2b9fae7477dd4a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.824936 22781 raft_consensus.cc:2463] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.824997 22851 leader_election.cc:304] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.825166 23134 raft_consensus.cc:2798] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.825214 23134 raft_consensus.cc:491] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.825248 23134 raft_consensus.cc:3054] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.826107 23134 raft_consensus.cc:513] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.826411 23134 leader_election.cc:290] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.826695 22457 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.826861 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91583c8ab6447428a2b9fae7477dd4a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.826952 22646 raft_consensus.cc:3054] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.827147 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91583c8ab6447428a2b9fae7477dd4a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.827243 22781 raft_consensus.cc:3054] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.827749 22646 raft_consensus.cc:2463] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.828018 22851 leader_election.cc:304] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.828164 22781 raft_consensus.cc:2463] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.828387 23134 raft_consensus.cc:2798] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.828514 23134 raft_consensus.cc:695] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:30.828626 23134 consensus_queue.cc:237] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
W20250112 21:02:30.830551 23125 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250112 21:02:30.830603 23125 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250112 21:02:30.830634 23125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250112 21:02:30.830665 23125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250112 21:02:30.830691 23125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250112 21:02:30.830719 23125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250112 21:02:30.832260 23040 ts_tablet_manager.cc:1918] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.832341 23040 log.cc:1198] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/0ebf8bb9004b41d7939a94acf2d2ef68
I20250112 21:02:30.832547 23040 ts_tablet_manager.cc:1939] T 0ebf8bb9004b41d7939a94acf2d2ef68 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.833158 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (table default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]) successfully deleted
I20250112 21:02:30.833372 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 833b963c15c94c40b685b841defeec4f
I20250112 21:02:30.833400 22459 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 42f011ccfe3741a09e48c51464f658ec
I20250112 21:02:30.833442 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0cca9c24edcd4c899be46abea69505d5
I20250112 21:02:30.833668 22459 catalog_manager.cc:6596] ReplaceTablet: tablet 42f011ccfe3741a09e48c51464f658ec deleted and replaced by tablet 282486f313de4e99ae57aff652e29b66
I20250112 21:02:30.833616 22465 catalog_manager.cc:5526] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.833792 22465 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.834175 23034 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.834199 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cca9c24edcd4c899be46abea69505d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.834314 23034 ts_tablet_manager.cc:1397] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250112 21:02:30.834184 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f011ccfe3741a09e48c51464f658ec with delete_type TABLET_DATA_DELETED (replaced by tablet 282486f313de4e99ae57aff652e29b66) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.834417 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cca9c24edcd4c899be46abea69505d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.834444 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f011ccfe3741a09e48c51464f658ec with delete_type TABLET_DATA_DELETED (replaced by tablet 282486f313de4e99ae57aff652e29b66) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.834546 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet a3a1f99179b94df3a621c8cfa07782fa
I20250112 21:02:30.834808 22460 catalog_manager.cc:6596] ReplaceTablet: tablet a3a1f99179b94df3a621c8cfa07782fa deleted and replaced by tablet 8f8b56cbc3e841a59f48fbe26dab73a9
I20250112 21:02:30.834777 23034 raft_consensus.cc:357] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.834831 22461 catalog_manager.cc:6596] ReplaceTablet: tablet 833b963c15c94c40b685b841defeec4f deleted and replaced by tablet 1f164e6da7724fa8996766a41a0c214a
I20250112 21:02:30.834869 23034 raft_consensus.cc:383] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.834899 23034 raft_consensus.cc:738] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.835014 23040 tablet_replica.cc:331] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.835026 23034 consensus_queue.cc:260] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.835129 23040 raft_consensus.cc:2238] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.835211 23040 raft_consensus.cc:2267] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.835389 23034 ts_tablet_manager.cc:1428] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.835608 23040 ts_tablet_manager.cc:1905] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.836782 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 833b963c15c94c40b685b841defeec4f with delete_type TABLET_DATA_DELETED (replaced by tablet 1f164e6da7724fa8996766a41a0c214a) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.836840 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet a3a1f99179b94df3a621c8cfa07782fa with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8b56cbc3e841a59f48fbe26dab73a9) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.836879 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet a3a1f99179b94df3a621c8cfa07782fa with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8b56cbc3e841a59f48fbe26dab73a9) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.837019 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 833b963c15c94c40b685b841defeec4f with delete_type TABLET_DATA_DELETED (replaced by tablet 1f164e6da7724fa8996766a41a0c214a) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.837769 23040 ts_tablet_manager.cc:1918] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.837836 23040 log.cc:1198] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/0644eab03d36474cbe6f363d15e36e73
I20250112 21:02:30.838007 23040 ts_tablet_manager.cc:1939] T 0644eab03d36474cbe6f363d15e36e73 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.838481 23040 tablet_replica.cc:331] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.838586 23040 raft_consensus.cc:2238] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.838616 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 0644eab03d36474cbe6f363d15e36e73 (table default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:30.838660 23040 raft_consensus.cc:2267] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.839004 23039 ts_tablet_manager.cc:1905] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.839051 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 0cca9c24edcd4c899be46abea69505d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.839262 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 42f011ccfe3741a09e48c51464f658ec with delete_type TABLET_DATA_DELETED (replaced by tablet 282486f313de4e99ae57aff652e29b66) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.839287 23038 tablet_replica.cc:331] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.839584 23125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.194.212:38917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.21.194.254:46215,127.21.194.253:36663,127.21.194.252:40219
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.194.254:46215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.194.254
--webserver_port=33441
--never_fsync=true
--heap_profile_path=/tmp/kudu.23125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision bda246888fb83d6b8131ddbb04f062f3e03180a8
build type DEBUG
built by None at 12 Jan 2025 20:43:15 UTC on 24a791456cd2
build id 4145
I20250112 21:02:30.839732 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet a3a1f99179b94df3a621c8cfa07782fa with delete_type TABLET_DATA_DELETED (replaced by tablet 8f8b56cbc3e841a59f48fbe26dab73a9) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.839776 23038 raft_consensus.cc:2238] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.839883 23038 raft_consensus.cc:2267] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.840492 22762 tablet_service.cc:1467] Processing CreateTablet for tablet ab7062bd844144599f4b80e82d6d80da (DEFAULT_TABLE table=default.Table_64fb8ef7b3f643399a091c234bcd8e67 [id=3b6e9944498d4cabb74a389a3a9bd5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.840761 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7062bd844144599f4b80e82d6d80da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.841130 23039 ts_tablet_manager.cc:1918] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.841185 23039 log.cc:1198] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/c428b8f4aa1d45a8b04b64fc824dfe6c
I20250112 21:02:30.841733 23040 ts_tablet_manager.cc:1905] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.841770 23125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250112 21:02:30.842404 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet 833b963c15c94c40b685b841defeec4f with delete_type TABLET_DATA_DELETED (replaced by tablet 1f164e6da7724fa8996766a41a0c214a) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.843082 22898 tablet_service.cc:1467] Processing CreateTablet for tablet ab7062bd844144599f4b80e82d6d80da (DEFAULT_TABLE table=default.Table_64fb8ef7b3f643399a091c234bcd8e67 [id=3b6e9944498d4cabb74a389a3a9bd5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.843127 23125 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250112 21:02:30.843325 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7062bd844144599f4b80e82d6d80da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.843412 23040 ts_tablet_manager.cc:1918] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.843469 23040 log.cc:1198] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/0cca9c24edcd4c899be46abea69505d5
I20250112 21:02:30.843637 23040 ts_tablet_manager.cc:1939] T 0cca9c24edcd4c899be46abea69505d5 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.843801 23039 ts_tablet_manager.cc:1939] T c428b8f4aa1d45a8b04b64fc824dfe6c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.844131 22757 tablet_service.cc:1467] Processing CreateTablet for tablet fbbcbb54b752415b8b97cc7e99df5318 (DEFAULT_TABLE table=default.Table_8d5adb649f2d4ea19c4c5e605bc2aa66 [id=1c25c4e9871d4f5fb36fdeb122180279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.844290 22759 tablet_service.cc:1467] Processing CreateTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d (DEFAULT_TABLE table=default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.844355 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcbb54b752415b8b97cc7e99df5318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.844503 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f84f8f5e44e4d30bacf77072a86765d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.844717 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 79d16ad34f414aa6bfba934463afef73 (DEFAULT_TABLE table=default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.844895 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d16ad34f414aa6bfba934463afef73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.844908 22627 tablet_service.cc:1467] Processing CreateTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 (DEFAULT_TABLE table=default.Table_29611f22fb9a4713a93adb161ea7f4fb [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.845125 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd45bb2c57a74ace9e09e89ee09cee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.845466 22624 tablet_service.cc:1467] Processing CreateTablet for tablet 79d16ad34f414aa6bfba934463afef73 (DEFAULT_TABLE table=default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.845652 22624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d16ad34f414aa6bfba934463afef73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.846235 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 71c22a901e6c4348a9b0e79598a93cae (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.846438 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c22a901e6c4348a9b0e79598a93cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.844148 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.846702 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ed04aaf0447ad9b016d39f3271aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.847016 22623 tablet_service.cc:1467] Processing CreateTablet for tablet fbbcbb54b752415b8b97cc7e99df5318 (DEFAULT_TABLE table=default.Table_8d5adb649f2d4ea19c4c5e605bc2aa66 [id=1c25c4e9871d4f5fb36fdeb122180279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.847221 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcbb54b752415b8b97cc7e99df5318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.847433 22625 tablet_service.cc:1467] Processing CreateTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.847642 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ed04aaf0447ad9b016d39f3271aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.848248 22622 tablet_service.cc:1467] Processing CreateTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d (DEFAULT_TABLE table=default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.848510 22622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f84f8f5e44e4d30bacf77072a86765d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.848985 22626 tablet_service.cc:1467] Processing CreateTablet for tablet ab7062bd844144599f4b80e82d6d80da (DEFAULT_TABLE table=default.Table_64fb8ef7b3f643399a091c234bcd8e67 [id=3b6e9944498d4cabb74a389a3a9bd5b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.849174 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7062bd844144599f4b80e82d6d80da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.849606 23034 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.850448 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 71c22a901e6c4348a9b0e79598a93cae (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.850543 23034 tablet_bootstrap.cc:654] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.850651 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c22a901e6c4348a9b0e79598a93cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.851166 23037 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.851596 22898 tablet_service.cc:1467] Processing CreateTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 (DEFAULT_TABLE table=default.Table_29611f22fb9a4713a93adb161ea7f4fb [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.851824 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd45bb2c57a74ace9e09e89ee09cee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.852988 23039 tablet_replica.cc:331] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.853149 23039 raft_consensus.cc:2238] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.853299 23039 raft_consensus.cc:2267] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.853332 23037 tablet_bootstrap.cc:654] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.854285 23039 ts_tablet_manager.cc:1905] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.854314 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 0cca9c24edcd4c899be46abea69505d5 (table default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]) successfully deleted
I20250112 21:02:30.854439 22898 tablet_service.cc:1467] Processing CreateTablet for tablet fbbcbb54b752415b8b97cc7e99df5318 (DEFAULT_TABLE table=default.Table_8d5adb649f2d4ea19c4c5e605bc2aa66 [id=1c25c4e9871d4f5fb36fdeb122180279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.854497 23040 tablet_replica.cc:331] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.854681 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbcbb54b752415b8b97cc7e99df5318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.854722 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet c428b8f4aa1d45a8b04b64fc824dfe6c (table default.Table_f90e77f194c947578af0716fc048db2a [id=22d0a7749b274fcba077dd05309c7c93]) successfully deleted
I20250112 21:02:30.854875 23040 raft_consensus.cc:2238] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.855252 22762 tablet_service.cc:1467] Processing CreateTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 (DEFAULT_TABLE table=default.Table_29611f22fb9a4713a93adb161ea7f4fb [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.855477 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd45bb2c57a74ace9e09e89ee09cee30. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.855463 23040 raft_consensus.cc:2267] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.857313 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 79d16ad34f414aa6bfba934463afef73 (DEFAULT_TABLE table=default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.857537 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d16ad34f414aa6bfba934463afef73. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.857589 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d (DEFAULT_TABLE table=default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.857630 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 71c22a901e6c4348a9b0e79598a93cae (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.857832 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f84f8f5e44e4d30bacf77072a86765d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.858439 23135 raft_consensus.cc:491] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.858520 23135 raft_consensus.cc:513] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.859293 23135 leader_election.cc:290] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:30.859727 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c22a901e6c4348a9b0e79598a93cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.860965 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f011ccfe3741a09e48c51464f658ec" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.861300 23135 raft_consensus.cc:491] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.861322 22462 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8f8b56cbc3e841a59f48fbe26dab73a9
I20250112 21:02:30.861371 23135 raft_consensus.cc:513] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.861681 23135 leader_election.cc:290] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.861852 23038 ts_tablet_manager.cc:1905] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.862288 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a252d2647f84d9aaac1fc26f0de81b0" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.862376 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a252d2647f84d9aaac1fc26f0de81b0" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.862425 22780 raft_consensus.cc:2463] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.862501 22647 raft_consensus.cc:2463] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.862923 23039 ts_tablet_manager.cc:1918] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.863001 23039 log.cc:1198] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/85651379d0cf4c2dbf80a3702598f881
I20250112 21:02:30.862977 22851 leader_election.cc:304] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.863173 23135 raft_consensus.cc:2798] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.863219 23039 ts_tablet_manager.cc:1939] T 85651379d0cf4c2dbf80a3702598f881 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.863224 23135 raft_consensus.cc:491] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.863260 23135 raft_consensus.cc:3054] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.863766 23039 tablet_replica.cc:331] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.863880 23039 raft_consensus.cc:2238] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.864010 23039 pending_rounds.cc:62] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:30.864039 23039 pending_rounds.cc:69] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715021258752 op_type: NO_OP noop_request { }
I20250112 21:02:30.864092 23039 raft_consensus.cc:2883] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.864063 23135 raft_consensus.cc:513] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.864138 23039 raft_consensus.cc:2267] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.864270 23040 ts_tablet_manager.cc:1905] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.865125 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a252d2647f84d9aaac1fc26f0de81b0" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.865249 22780 raft_consensus.cc:3054] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.865294 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a252d2647f84d9aaac1fc26f0de81b0" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.865391 22647 raft_consensus.cc:3054] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.866113 22647 raft_consensus.cc:2463] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.866122 22780 raft_consensus.cc:2463] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:30.866153 23040 ts_tablet_manager.cc:1918] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.866201 23040 log.cc:1198] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/42f011ccfe3741a09e48c51464f658ec
I20250112 21:02:30.866379 23040 ts_tablet_manager.cc:1939] T 42f011ccfe3741a09e48c51464f658ec P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.864375 23135 leader_election.cc:290] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.866716 22458 catalog_manager.cc:5526] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.866845 23038 ts_tablet_manager.cc:1918] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.866899 23038 log.cc:1198] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/0cca9c24edcd4c899be46abea69505d5
I20250112 21:02:30.866603 22851 leader_election.cc:304] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.867100 23038 ts_tablet_manager.cc:1939] T 0cca9c24edcd4c899be46abea69505d5 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.867138 23135 raft_consensus.cc:2798] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.867210 23135 raft_consensus.cc:695] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:30.867328 23135 consensus_queue.cc:237] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.867640 23036 tablet_bootstrap.cc:492] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.867712 23036 ts_tablet_manager.cc:1397] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.000s
I20250112 21:02:30.868273 23037 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.868355 23037 ts_tablet_manager.cc:1397] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250112 21:02:30.868846 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 85651379d0cf4c2dbf80a3702598f881 (table default.Table_d0e9b4f48ca14e93a2ce7d0b02fceb4c [id=2f8bcc6af6544784adadf5545e4ea1d1]) successfully deleted
I20250112 21:02:30.868834 23037 raft_consensus.cc:357] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.868922 23037 raft_consensus.cc:383] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.868953 23037 raft_consensus.cc:738] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.869055 23037 consensus_queue.cc:260] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.868395 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42f011ccfe3741a09e48c51464f658ec" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.869357 23037 ts_tablet_manager.cc:1428] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.869473 22781 raft_consensus.cc:2463] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:30.869527 23037 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.869809 22851 leader_election.cc:304] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:30.869828 23049 raft_consensus.cc:491] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.869900 23049 raft_consensus.cc:513] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.870046 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf (DEFAULT_TABLE table=default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.870240 23049 leader_election.cc:290] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.870286 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159ed04aaf0447ad9b016d39f3271aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.870667 23037 tablet_bootstrap.cc:654] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.870774 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a1f99179b94df3a621c8cfa07782fa" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.871022 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a1f99179b94df3a621c8cfa07782fa" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.871126 22781 raft_consensus.cc:2463] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
W20250112 21:02:30.871140 22582 leader_election.cc:343] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.871366 22580 leader_election.cc:304] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.871595 23049 raft_consensus.cc:2798] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.871642 23049 raft_consensus.cc:491] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.871676 23049 raft_consensus.cc:3054] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.871759 23038 tablet_replica.cc:331] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.871871 23038 raft_consensus.cc:2238] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.871953 23038 raft_consensus.cc:2267] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.872145 23040 tablet_replica.cc:331] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.872265 23040 raft_consensus.cc:2238] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.872365 23040 raft_consensus.cc:2267] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.872560 23049 raft_consensus.cc:513] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.872826 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 42f011ccfe3741a09e48c51464f658ec (table default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]) successfully deleted
I20250112 21:02:30.872864 23049 leader_election.cc:290] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:30.872891 23040 ts_tablet_manager.cc:1905] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.873407 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a1f99179b94df3a621c8cfa07782fa" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.873536 22781 raft_consensus.cc:3054] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.874307 23034 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.874402 23034 ts_tablet_manager.cc:1397] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20250112 21:02:30.874557 22781 raft_consensus.cc:2463] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.874598 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3a1f99179b94df3a621c8cfa07782fa" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.874852 22580 leader_election.cc:304] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.874836 23034 raft_consensus.cc:357] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.874927 23034 raft_consensus.cc:383] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.874959 23034 raft_consensus.cc:738] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.875038 23049 raft_consensus.cc:2798] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.874997 23036 raft_consensus.cc:357] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.875087 23036 raft_consensus.cc:383] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.875104 23049 raft_consensus.cc:695] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.875115 23036 raft_consensus.cc:738] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.875103 23034 consensus_queue.cc:260] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.875201 23036 consensus_queue.cc:260] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.875211 23049 consensus_queue.cc:237] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.875255 23040 ts_tablet_manager.cc:1918] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.875312 23040 log.cc:1198] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/833b963c15c94c40b685b841defeec4f
I20250112 21:02:30.875458 23036 ts_tablet_manager.cc:1428] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20250112 21:02:30.875537 23040 ts_tablet_manager.cc:1939] T 833b963c15c94c40b685b841defeec4f P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.875618 23036 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.875993 23040 tablet_replica.cc:331] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.876085 23040 raft_consensus.cc:2238] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.876153 23034 ts_tablet_manager.cc:1428] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.876195 23040 pending_rounds.cc:62] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:30.876232 23040 pending_rounds.cc:69] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715586039808 op_type: NO_OP noop_request { }
I20250112 21:02:30.876278 23040 raft_consensus.cc:2883] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.876308 23034 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.876322 23040 raft_consensus.cc:2267] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.876540 23036 tablet_bootstrap.cc:654] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.877337 23217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250112 21:02:30.877718 22582 leader_election.cc:343] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.878069 23037 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
W20250112 21:02:30.878104 23215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:30.878139 23037 ts_tablet_manager.cc:1397] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
W20250112 21:02:30.878234 23214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250112 21:02:30.878526 23037 raft_consensus.cc:357] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.878559 23125 server_base.cc:1034] running on GCE node
I20250112 21:02:30.878618 23037 raft_consensus.cc:383] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.878644 23037 raft_consensus.cc:738] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.878739 23037 consensus_queue.cc:260] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.878971 23037 ts_tablet_manager.cc:1428] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.879130 23037 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.880033 23037 tablet_bootstrap.cc:654] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:30.880335 22851 raft_consensus.cc:2681] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20250112 21:02:30.880661 22851 leader_election.cc:343] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.881870 22781 raft_consensus.cc:1270] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.882565 23135 consensus_queue.cc:1035] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.882815 22457 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_29611f22fb9a4713a93adb161ea7f4fb [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 1 got 0
I20250112 21:02:30.883111 23125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250112 21:02:30.883873 22647 raft_consensus.cc:1270] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.883978 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 833b963c15c94c40b685b841defeec4f (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:30.884313 23125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250112 21:02:30.884749 23039 ts_tablet_manager.cc:1905] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.884666 22457 catalog_manager.cc:5526] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.885859 23135 consensus_queue.cc:1035] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.886668 23084 tablet.cc:1721] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250112 21:02:30.887075 23149 tablet.cc:1721] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250112 21:02:30.888218 23037 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.888309 23037 ts_tablet_manager.cc:1397] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250112 21:02:30.888739 23037 raft_consensus.cc:357] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.888828 23037 raft_consensus.cc:383] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.888856 23037 raft_consensus.cc:738] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.888944 23037 consensus_queue.cc:260] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.888984 23083 tablet.cc:1721] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20250112 21:02:30.889179 23037 ts_tablet_manager.cc:1428] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.889631 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.892100 23037 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.893282 23039 ts_tablet_manager.cc:1918] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.893599 23037 tablet_bootstrap.cc:654] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.893711 23039 log.cc:1198] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0ebf8bb9004b41d7939a94acf2d2ef68
I20250112 21:02:30.893996 23039 ts_tablet_manager.cc:1939] T 0ebf8bb9004b41d7939a94acf2d2ef68 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.894094 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]). Expected version 4 got 0
I20250112 21:02:30.894132 23038 ts_tablet_manager.cc:1905] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.894825 23037 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.894903 23037 ts_tablet_manager.cc:1397] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.895320 23037 raft_consensus.cc:357] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.895417 23037 raft_consensus.cc:383] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.895444 23037 raft_consensus.cc:738] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.895546 23037 consensus_queue.cc:260] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.895787 23037 ts_tablet_manager.cc:1428] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.895936 23038 ts_tablet_manager.cc:1918] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.895962 23037 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.896000 23038 log.cc:1198] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/42f011ccfe3741a09e48c51464f658ec
I20250112 21:02:30.896170 23038 ts_tablet_manager.cc:1939] T 42f011ccfe3741a09e48c51464f658ec P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.896937 23037 tablet_bootstrap.cc:654] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.897008 23038 tablet_replica.cc:331] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.897118 23038 raft_consensus.cc:2238] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.897164 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0ebf8bb9004b41d7939a94acf2d2ef68 (table default.Table_f3a29e661dd34f458c8ebeeaf8a33b68 [id=23cc4ddcb5ea4067912136fc670972b4]) successfully deleted
I20250112 21:02:30.897204 23038 raft_consensus.cc:2267] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.897468 23039 tablet_replica.cc:331] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.897575 23038 ts_tablet_manager.cc:1905] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.897593 23039 raft_consensus.cc:2238] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.897727 23039 pending_rounds.cc:62] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:30.897758 23039 pending_rounds.cc:69] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587714071900160 op_type: NO_OP noop_request { }
I20250112 21:02:30.897805 23039 raft_consensus.cc:2883] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:30.897850 23039 raft_consensus.cc:2267] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.898741 23039 ts_tablet_manager.cc:1905] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.899364 23038 ts_tablet_manager.cc:1918] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.899441 23038 log.cc:1198] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/a3a1f99179b94df3a621c8cfa07782fa
I20250112 21:02:30.899623 23038 ts_tablet_manager.cc:1939] T a3a1f99179b94df3a621c8cfa07782fa P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.899911 23125 hybrid_clock.cc:648] HybridClock initialized: now 1736715750897998 us; error 1927 us; skew 500 ppm
I20250112 21:02:30.900233 23038 tablet_replica.cc:331] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.900341 23038 raft_consensus.cc:2238] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.900532 23038 raft_consensus.cc:2267] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.901074 23038 ts_tablet_manager.cc:1905] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:30.901630 23221 consensus_queue.cc:1159] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d8faec3969b64c33a4bf9aba509785ea" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250112 21:02:30.902266 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8e062e896147436498e4d4794cd1064d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.902631 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e062e896147436498e4d4794cd1064d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.902540 23040 ts_tablet_manager.cc:1905] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.902750 23125 webserver.cc:458] Webserver started at http://127.21.194.254:33441/ using document root <none> and password file <none>
I20250112 21:02:30.902946 23038 ts_tablet_manager.cc:1918] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.903007 23038 log.cc:1198] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/833b963c15c94c40b685b841defeec4f
I20250112 21:02:30.903241 23038 ts_tablet_manager.cc:1939] T 833b963c15c94c40b685b841defeec4f P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.903434 23125 fs_manager.cc:362] Metadata directory not provided
I20250112 21:02:30.903519 23125 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250112 21:02:30.904363 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 0cca9c24edcd4c899be46abea69505d5 (table default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]) successfully deleted
I20250112 21:02:30.904390 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_75dbe00b4ac144fda1277b451c425944"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.904485 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_950907394c814cf49909c3b8286c64af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.904649 23040 ts_tablet_manager.cc:1918] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.904721 23040 log.cc:1198] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/a3a1f99179b94df3a621c8cfa07782fa
W20250112 21:02:30.904758 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75dbe00b4ac144fda1277b451c425944 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:30.904784 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_950907394c814cf49909c3b8286c64af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.904949 23040 ts_tablet_manager.cc:1939] T a3a1f99179b94df3a621c8cfa07782fa P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.904994 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 42f011ccfe3741a09e48c51464f658ec (table default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]) successfully deleted
I20250112 21:02:30.905140 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 833b963c15c94c40b685b841defeec4f (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:30.906383 23039 ts_tablet_manager.cc:1918] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:30.906458 23039 log.cc:1198] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0644eab03d36474cbe6f363d15e36e73
I20250112 21:02:30.906526 23034 tablet_bootstrap.cc:654] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.906687 23039 ts_tablet_manager.cc:1939] T 0644eab03d36474cbe6f363d15e36e73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.907281 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0644eab03d36474cbe6f363d15e36e73 (table default.Table_41b6d08b98ad4f95bb9fcfac9d47c313 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:30.907533 23034 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.907862 23037 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.907868 23034 ts_tablet_manager.cc:1397] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250112 21:02:30.907944 23037 ts_tablet_manager.cc:1397] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250112 21:02:30.908344 23037 raft_consensus.cc:357] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.908488 23037 raft_consensus.cc:383] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.908540 23037 raft_consensus.cc:738] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.908433 23034 raft_consensus.cc:357] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.908695 23034 raft_consensus.cc:383] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.908685 23037 consensus_queue.cc:260] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.908803 23034 raft_consensus.cc:738] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.908955 23037 ts_tablet_manager.cc:1428] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.908987 23034 consensus_queue.cc:260] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.909142 23037 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.910244 23034 ts_tablet_manager.cc:1428] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:30.910665 23037 tablet_bootstrap.cc:654] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.911087 22458 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34] alter complete (version 4)
I20250112 21:02:30.911230 23039 tablet_replica.cc:331] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.911507 23039 raft_consensus.cc:2238] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.911720 23039 raft_consensus.cc:2267] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.912479 23039 ts_tablet_manager.cc:1905] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.914636 23034 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.915004 23039 ts_tablet_manager.cc:1918] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.915107 23039 log.cc:1198] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0cca9c24edcd4c899be46abea69505d5
I20250112 21:02:30.915328 23039 ts_tablet_manager.cc:1939] T 0cca9c24edcd4c899be46abea69505d5 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.915792 23034 tablet_bootstrap.cc:654] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.915916 23039 tablet_replica.cc:331] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.915963 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0cca9c24edcd4c899be46abea69505d5 (table default.Table_60f17231f22844be8035401f830c0758 [id=2b74480947c44a829d63b2ad18d37649]) successfully deleted
I20250112 21:02:30.916090 23039 raft_consensus.cc:2238] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.916211 23039 raft_consensus.cc:2267] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.916699 23039 ts_tablet_manager.cc:1905] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.917878 23125 fs_manager.cc:714] Time spent opening directory manager: real 0.012s user 0.003s sys 0.001s
I20250112 21:02:30.918351 23039 ts_tablet_manager.cc:1918] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.918409 23039 log.cc:1198] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/42f011ccfe3741a09e48c51464f658ec
I20250112 21:02:30.918581 23039 ts_tablet_manager.cc:1939] T 42f011ccfe3741a09e48c51464f658ec P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.919034 23036 tablet_bootstrap.cc:492] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.919102 23036 ts_tablet_manager.cc:1397] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.000s
I20250112 21:02:30.919209 23039 tablet_replica.cc:331] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.919310 23039 raft_consensus.cc:2238] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.919389 23039 raft_consensus.cc:2267] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.919510 23036 raft_consensus.cc:357] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.919615 23036 raft_consensus.cc:383] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.919646 23036 raft_consensus.cc:738] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.919770 23039 ts_tablet_manager.cc:1905] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.919762 23036 consensus_queue.cc:260] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:30.920017 23036 ts_tablet_manager.cc:1428] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.920198 23036 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.920514 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 42f011ccfe3741a09e48c51464f658ec (table default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]) successfully deleted
I20250112 21:02:30.921578 23039 ts_tablet_manager.cc:1918] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:30.921653 23039 log.cc:1198] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/a3a1f99179b94df3a621c8cfa07782fa
I20250112 21:02:30.921867 23039 ts_tablet_manager.cc:1939] T a3a1f99179b94df3a621c8cfa07782fa P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.922150 23036 tablet_bootstrap.cc:654] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.922437 23039 tablet_replica.cc:331] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.922600 23236 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250112 21:02:30.922607 23039 raft_consensus.cc:2238] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.922791 23039 raft_consensus.cc:2267] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.923084 23036 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.923161 23036 ts_tablet_manager.cc:1397] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:30.923255 23039 ts_tablet_manager.cc:1905] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.923635 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c5c9b2146c6e4763ab12d878d7fc03e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.923990 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5c9b2146c6e4763ab12d878d7fc03e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.924078 23125 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:30.925016 23039 ts_tablet_manager.cc:1918] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.925088 23039 log.cc:1198] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/833b963c15c94c40b685b841defeec4f
I20250112 21:02:30.925300 23039 ts_tablet_manager.cc:1939] T 833b963c15c94c40b685b841defeec4f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.924181 23125 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data,/tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
uuid: "81853a8db6f14748910205ef23843fa0"
format_stamp: "Formatted at 2025-01-12 21:02:28 on dist-test-slave-26c7"
I20250112 21:02:30.925638 23125 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250112 21:02:30.926255 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 833b963c15c94c40b685b841defeec4f (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:30.926461 23036 raft_consensus.cc:357] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.926560 23036 raft_consensus.cc:383] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.926595 23036 raft_consensus.cc:738] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.926720 23036 consensus_queue.cc:260] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.927369 23036 ts_tablet_manager.cc:1428] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:30.928611 23036 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:30.930411 23036 tablet_bootstrap.cc:654] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.930948 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 1f164e6da7724fa8996766a41a0c214a (DEFAULT_TABLE table=default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.931180 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f164e6da7724fa8996766a41a0c214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.931389 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 1f164e6da7724fa8996766a41a0c214a (DEFAULT_TABLE table=default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.931780 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f164e6da7724fa8996766a41a0c214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.931768 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 1f164e6da7724fa8996766a41a0c214a (DEFAULT_TABLE table=default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.932006 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f164e6da7724fa8996766a41a0c214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.932193 23065 raft_consensus.cc:491] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.932278 23065 raft_consensus.cc:513] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.932628 23065 leader_election.cc:290] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:30.933002 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe1bc020af84f039e1560c7ae4f9176" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:30.933120 22647 raft_consensus.cc:2463] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:30.933418 22715 leader_election.cc:304] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.933576 23065 raft_consensus.cc:2798] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.933634 23065 raft_consensus.cc:491] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.933670 23065 raft_consensus.cc:3054] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.934252 23049 raft_consensus.cc:491] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.934346 23049 raft_consensus.cc:513] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.934476 23065 raft_consensus.cc:513] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.934657 23049 leader_election.cc:290] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.934777 23065 leader_election.cc:290] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:30.934990 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f84f8f5e44e4d30bacf77072a86765d" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.935101 22781 raft_consensus.cc:2463] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.935135 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe1bc020af84f039e1560c7ae4f9176" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.935226 22918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe1bc020af84f039e1560c7ae4f9176" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:30.935309 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f84f8f5e44e4d30bacf77072a86765d" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.935384 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe1bc020af84f039e1560c7ae4f9176" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:30.935464 22647 raft_consensus.cc:3054] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.935232 22916 raft_consensus.cc:2463] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
W20250112 21:02:30.935825 22582 leader_election.cc:343] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.936218 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 282486f313de4e99ae57aff652e29b66 (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.936301 22647 raft_consensus.cc:2463] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:30.936470 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282486f313de4e99ae57aff652e29b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.936635 22715 leader_election.cc:304] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.936880 22580 leader_election.cc:304] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.937108 23065 raft_consensus.cc:2798] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.937184 23065 raft_consensus.cc:695] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:30.937297 23065 consensus_queue.cc:237] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.937556 23049 raft_consensus.cc:2798] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.937604 23049 raft_consensus.cc:491] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.937640 23049 raft_consensus.cc:3054] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.938400 23049 raft_consensus.cc:513] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.938697 23049 leader_election.cc:290] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.939512 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 282486f313de4e99ae57aff652e29b66 (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.939589 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f84f8f5e44e4d30bacf77072a86765d" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.939692 22781 raft_consensus.cc:3054] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.939742 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282486f313de4e99ae57aff652e29b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.940544 22781 raft_consensus.cc:2463] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:30.941156 22461 catalog_manager.cc:5526] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:30.942552 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f84f8f5e44e4d30bacf77072a86765d" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:30.942942 22582 leader_election.cc:343] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.943543 22580 leader_election.cc:304] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.944613 23037 tablet_bootstrap.cc:492] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.944697 23037 ts_tablet_manager.cc:1397] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20250112 21:02:30.944811 23049 raft_consensus.cc:2798] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.944892 23049 raft_consensus.cc:695] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.945013 23049 consensus_queue.cc:237] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.945142 23037 raft_consensus.cc:357] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.945254 23037 raft_consensus.cc:383] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.945282 23037 raft_consensus.cc:738] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.945389 23037 consensus_queue.cc:260] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.945663 23037 ts_tablet_manager.cc:1428] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.945822 23037 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.946731 23037 tablet_bootstrap.cc:654] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.946907 22462 catalog_manager.cc:5526] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.948249 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_41b6d08b98ad4f95bb9fcfac9d47c313" } new_table_name: "default.Table_9d4cd578620c44e4991b125af874b287" modify_external_catalogs: true
I20250112 21:02:30.948321 23034 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.948350 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 282486f313de4e99ae57aff652e29b66 (DEFAULT_TABLE table=default.Table_fbc86351fd1f4869bdb002b6fe76ba8f [id=372bcd1b7412419bb6a2a7a6bc87dd4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:30.948628 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282486f313de4e99ae57aff652e29b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:30.948567 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_0af1b886425c45f0b7e33eb26e8f2796"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.948875 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0af1b886425c45f0b7e33eb26e8f2796 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.949169 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_d44d3f76b31747b784d209adf5c87d92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.949489 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d44d3f76b31747b784d209adf5c87d92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.949689 22458 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_8e062e896147436498e4d4794cd1064d" } new_table_name: "default.Table_c9e9561973fb4223909807e9f1f6779b" modify_external_catalogs: true
I20250112 21:02:30.949963 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_19b0a72a5b4547e2925b2761711c4951"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.950237 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19b0a72a5b4547e2925b2761711c4951 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.950430 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_29611f22fb9a4713a93adb161ea7f4fb" } new_table_name: "default.Table_084d6398ba27408cad969d11e96ec80b" modify_external_catalogs: true
I20250112 21:02:30.950246 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_bf0165659b1547e2843f8ac01f667c83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.951066 23034 ts_tablet_manager.cc:1397] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.001s
W20250112 21:02:30.951120 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf0165659b1547e2843f8ac01f667c83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.951365 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_197cf0808f644f2aac394ec59f82d263"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:30.951495 23118 raft_consensus.cc:491] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:30.951571 23118 raft_consensus.cc:513] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
W20250112 21:02:30.951654 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_197cf0808f644f2aac394ec59f82d263 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.951870 23118 leader_election.cc:290] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.951908 23034 raft_consensus.cc:357] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.952011 23034 raft_consensus.cc:383] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.952044 23034 raft_consensus.cc:738] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.952162 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d16ad34f414aa6bfba934463afef73" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:30.952184 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d16ad34f414aa6bfba934463afef73" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:30.952184 23034 consensus_queue.cc:260] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.952340 22781 raft_consensus.cc:2463] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:30.952540 23036 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.952555 23034 ts_tablet_manager.cc:1428] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.952617 23036 ts_tablet_manager.cc:1397] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250112 21:02:30.952672 22580 leader_election.cc:304] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:30.952729 23034 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.952939 23119 raft_consensus.cc:2798] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:30.952991 23119 raft_consensus.cc:491] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:30.953025 23119 raft_consensus.cc:3054] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.953634 23034 tablet_bootstrap.cc:654] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.953779 23119 raft_consensus.cc:513] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.954041 23119 leader_election.cc:290] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:30.954320 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d16ad34f414aa6bfba934463afef73" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:30.954418 22781 raft_consensus.cc:3054] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:30.954600 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79d16ad34f414aa6bfba934463afef73" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:30.955092 22582 leader_election.cc:343] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.955329 22781 raft_consensus.cc:2463] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
W20250112 21:02:30.955425 22582 leader_election.cc:343] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:30.955727 22580 leader_election.cc:304] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:30.955917 23118 raft_consensus.cc:2798] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:30.955996 23118 raft_consensus.cc:695] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:30.956107 23118 consensus_queue.cc:237] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.956532 23036 raft_consensus.cc:357] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.956625 23036 raft_consensus.cc:383] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.957039 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d5adf7b63dfd4ab2bfac21301d6669e4" } new_table_name: "default.Table_0126ff3f63db452aa29542957b7ddcbf" modify_external_catalogs: true
I20250112 21:02:30.956656 23036 raft_consensus.cc:738] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.958245 23036 consensus_queue.cc:260] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.959501 23036 ts_tablet_manager.cc:1428] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20250112 21:02:30.959791 23036 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:30.961910 22457 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 159ed04aaf0447ad9b016d39f3271aaf consensus state has no leader
I20250112 21:02:30.962510 22457 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_29611f22fb9a4713a93adb161ea7f4fb [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 1 got 0
I20250112 21:02:30.962709 22462 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_b940e6b6c4df4f7d841f68157ae30700" } modify_external_catalogs: true
I20250112 21:02:30.962802 22462 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_b940e6b6c4df4f7d841f68157ae30700" } modify_external_catalogs: true
I20250112 21:02:30.964310 23036 tablet_bootstrap.cc:654] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.964490 23125 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250112 21:02:30.965274 23125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250112 21:02:30.965402 23036 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.965446 23125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250112 21:02:30.965489 23036 ts_tablet_manager.cc:1397] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:30.965934 23036 raft_consensus.cc:357] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.966042 23036 raft_consensus.cc:383] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.966077 23036 raft_consensus.cc:738] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.966217 23036 consensus_queue.cc:260] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.966568 22460 catalog_manager.cc:5526] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:30.967085 23034 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.967172 23034 ts_tablet_manager.cc:1397] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20250112 21:02:30.967653 23034 raft_consensus.cc:357] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.967758 23034 raft_consensus.cc:383] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.967792 23034 raft_consensus.cc:738] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.966490 23036 ts_tablet_manager.cc:1428] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.967904 23034 consensus_queue.cc:260] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.968163 23034 ts_tablet_manager.cc:1428] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:30.968362 23034 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:30.969516 22458 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d53dd4efde384b5d911f82e8d88326b8 has no consensus state
I20250112 21:02:30.969763 23036 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:30.969769 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd45bb2c57a74ace9e09e89ee09cee30 consensus state has no leader
I20250112 21:02:30.970239 23034 tablet_bootstrap.cc:654] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.971951 22781 raft_consensus.cc:1270] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.972100 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_78295df1f6bd4a6694a742e692d31fa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:30.972465 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78295df1f6bd4a6694a742e692d31fa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:30.972534 22916 raft_consensus.cc:1270] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.972971 23037 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:30.973054 23037 ts_tablet_manager.cc:1397] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s
I20250112 21:02:30.973032 23119 consensus_queue.cc:1035] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.973135 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c5c9b2146c6e4763ab12d878d7fc03e8" } modify_external_catalogs: true
I20250112 21:02:30.973213 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c5c9b2146c6e4763ab12d878d7fc03e8" } modify_external_catalogs: true
I20250112 21:02:30.973611 23037 raft_consensus.cc:357] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.973706 23037 raft_consensus.cc:383] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.973737 23037 raft_consensus.cc:738] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.973842 23037 consensus_queue.cc:260] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.973906 23119 consensus_queue.cc:1035] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:30.974102 23037 ts_tablet_manager.cc:1428] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.974164 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:30.974313 22457 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 2 got 0
I20250112 21:02:30.976600 23037 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:30.977530 23037 tablet_bootstrap.cc:654] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.977556 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet e91583c8ab6447428a2b9fae7477dd4a
I20250112 21:02:30.979811 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet b3248b954b544c6abc850dda72aaee00 (table default.Table_0126ff3f63db452aa29542957b7ddcbf [id=8ef8b7c86df94166b526d83a12e78cd5]). Expected version 1 got 0
I20250112 21:02:30.980526 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:30.980630 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet b3248b954b544c6abc850dda72aaee00 (table default.Table_0126ff3f63db452aa29542957b7ddcbf [id=8ef8b7c86df94166b526d83a12e78cd5]). Expected version 1 got 0
I20250112 21:02:30.980948 23034 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.981024 23034 ts_tablet_manager.cc:1397] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250112 21:02:30.981024 22898 tablet_service.cc:1514] Processing DeleteTablet for tablet e91583c8ab6447428a2b9fae7477dd4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:30.981165 22621 tablet_service.cc:1514] Processing DeleteTablet for tablet e91583c8ab6447428a2b9fae7477dd4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:30.981372 23040 tablet_replica.cc:331] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:30.981531 23040 raft_consensus.cc:2238] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.981505 23034 raft_consensus.cc:357] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.981612 23034 raft_consensus.cc:383] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.981642 23034 raft_consensus.cc:738] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.981643 23040 raft_consensus.cc:2267] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.981762 23034 consensus_queue.cc:260] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:30.982020 23034 ts_tablet_manager.cc:1428] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:30.982196 23034 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.983139 23034 tablet_bootstrap.cc:654] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.983165 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet e91583c8ab6447428a2b9fae7477dd4a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:30.983570 22461 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6f6eb97b5e94405b88257a93ac1b29c2
I20250112 21:02:30.983654 23040 ts_tablet_manager.cc:1905] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.983706 23038 tablet_replica.cc:331] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:30.983825 23038 raft_consensus.cc:2238] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:30.984033 23038 raft_consensus.cc:2267] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.985054 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:30.985772 23040 ts_tablet_manager.cc:1918] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.985817 23038 ts_tablet_manager.cc:1905] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.985841 23040 log.cc:1198] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/e91583c8ab6447428a2b9fae7477dd4a
I20250112 21:02:30.986348 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]). Expected version 1 got 0
I20250112 21:02:30.987679 23040 ts_tablet_manager.cc:1939] T e91583c8ab6447428a2b9fae7477dd4a P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:30.987823 23038 ts_tablet_manager.cc:1918] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.987879 23038 log.cc:1198] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/e91583c8ab6447428a2b9fae7477dd4a
I20250112 21:02:30.988085 23038 ts_tablet_manager.cc:1939] T e91583c8ab6447428a2b9fae7477dd4a P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:30.988186 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]). Expected version 1 got 0
I20250112 21:02:30.988435 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.988726 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.988934 23039 tablet_replica.cc:331] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:30.989060 23039 raft_consensus.cc:2238] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:30.989176 23039 raft_consensus.cc:2267] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:30.989892 23125 rpc_server.cc:307] RPC server started. Bound to: 127.21.194.254:46215
I20250112 21:02:30.989936 23036 tablet_bootstrap.cc:654] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.990767 23039 ts_tablet_manager.cc:1905] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:30.991340 23125 server_base.cc:1166] Dumped server information to /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/master-0/data/info.pb
I20250112 21:02:30.991888 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3efed8387f734f2896cc733cf475fe00" } new_table_name: "default.Table_805fe24f44d64d60ad6655a1ae8a0027" modify_external_catalogs: true
I20250112 21:02:30.992205 22283 external_mini_cluster.cc:1413] Started /tmp/dist-test-task2b0lOt/build/debug/bin/kudu as pid 23125
I20250112 21:02:30.992884 23039 ts_tablet_manager.cc:1918] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:30.992947 23039 log.cc:1198] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/e91583c8ab6447428a2b9fae7477dd4a
I20250112 21:02:30.992990 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_19b0a72a5b4547e2925b2761711c4951" } modify_external_catalogs: true
I20250112 21:02:30.993079 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_19b0a72a5b4547e2925b2761711c4951" } modify_external_catalogs: true
I20250112 21:02:30.993168 23039 ts_tablet_manager.cc:1939] T e91583c8ab6447428a2b9fae7477dd4a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:30.993644 23036 tablet_bootstrap.cc:492] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:30.993736 23036 ts_tablet_manager.cc:1397] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250112 21:02:30.994168 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet e91583c8ab6447428a2b9fae7477dd4a (table default.Table_b940e6b6c4df4f7d841f68157ae30700 [id=7b9443a82d6f4204a2a2d3b3c7410e34]) successfully deleted
I20250112 21:02:30.994181 23036 raft_consensus.cc:357] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.994271 23036 raft_consensus.cc:383] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.994302 23036 raft_consensus.cc:738] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.994447 23036 consensus_queue.cc:260] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.996523 23034 tablet_bootstrap.cc:492] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:30.996608 23034 ts_tablet_manager.cc:1397] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250112 21:02:30.997370 23034 raft_consensus.cc:357] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.997478 23034 raft_consensus.cc:383] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:30.997509 23034 raft_consensus.cc:738] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:30.997502 23083 tablet.cc:1721] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:30.997618 23034 consensus_queue.cc:260] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:30.997864 23034 ts_tablet_manager.cc:1428] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:30.998040 23034 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:30.998103 22647 raft_consensus.cc:1270] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.999023 23034 tablet_bootstrap.cc:654] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:30.999048 22916 raft_consensus.cc:1270] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:30.999547 23065 consensus_queue.cc:1035] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.000608 23301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.194.254:46215 every 8 connection(s)
I20250112 21:02:31.000965 23084 tablet.cc:1721] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.001739 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet b3248b954b544c6abc850dda72aaee00 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.002518 23065 consensus_queue.cc:1035] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.003532 23036 ts_tablet_manager.cc:1428] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20250112 21:02:31.006405 23037 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.006486 23303 sys_catalog.cc:263] Verifying existing consensus state
I20250112 21:02:31.006496 23037 ts_tablet_manager.cc:1397] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20250112 21:02:31.006935 23037 raft_consensus.cc:357] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.007035 23037 raft_consensus.cc:383] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.007066 23037 raft_consensus.cc:738] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.007175 23037 consensus_queue.cc:260] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.007225 23034 tablet_bootstrap.cc:492] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.007299 23034 ts_tablet_manager.cc:1397] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250112 21:02:31.007474 23037 ts_tablet_manager.cc:1428] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.007632 23037 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.007726 23034 raft_consensus.cc:357] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.007817 23034 raft_consensus.cc:383] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.007843 23034 raft_consensus.cc:738] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.007949 23034 consensus_queue.cc:260] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.008210 23034 ts_tablet_manager.cc:1428] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.008353 23149 tablet.cc:1721] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.008550 23303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Bootstrap starting.
I20250112 21:02:31.008608 23135 raft_consensus.cc:491] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.008692 23135 raft_consensus.cc:513] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.009009 23135 leader_election.cc:290] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.008368 23034 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.009778 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbbcbb54b752415b8b97cc7e99df5318" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.009889 22646 raft_consensus.cc:2463] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.010314 22851 leader_election.cc:304] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.010349 23034 tablet_bootstrap.cc:654] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.010550 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbbcbb54b752415b8b97cc7e99df5318" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.010653 22781 raft_consensus.cc:2463] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.010973 23135 raft_consensus.cc:2798] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.011029 23135 raft_consensus.cc:491] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.011066 23135 raft_consensus.cc:3054] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.011943 23135 raft_consensus.cc:513] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.012253 23135 leader_election.cc:290] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.012511 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet bd45bb2c57a74ace9e09e89ee09cee30 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.012915 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbbcbb54b752415b8b97cc7e99df5318" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.013010 22781 raft_consensus.cc:3054] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.013016 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbbcbb54b752415b8b97cc7e99df5318" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.013101 22646 raft_consensus.cc:3054] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.013743 23036 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.013845 22781 raft_consensus.cc:2463] T fbbcbb54b752415b8b97cc7e99df5318 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:31.013947 22646 raft_consensus.cc:2463] T fbbcbb54b752415b8b97cc7e99df5318 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:31.014179 22851 leader_election.cc:304] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:31.014595 23135 raft_consensus.cc:2798] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.014669 23036 tablet_bootstrap.cc:654] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.014678 23135 raft_consensus.cc:695] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:31.014937 23303 log.cc:826] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Log is configured to *not* fsync() on all Append() calls
I20250112 21:02:31.015059 23135 consensus_queue.cc:237] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.015607 23037 tablet_bootstrap.cc:654] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.015745 23034 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.015817 23034 ts_tablet_manager.cc:1397] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:31.016223 23034 raft_consensus.cc:357] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.016312 23034 raft_consensus.cc:383] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.016342 23034 raft_consensus.cc:738] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.018842 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.018903 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.019094 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf8cc5d3604e7ab814be894c842fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.019095 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf8cc5d3604e7ab814be894c842fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.021278 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 04616ed61b134e889503c3b336ad4054 (DEFAULT_TABLE table=default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.021522 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04616ed61b134e889503c3b336ad4054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.022351 23034 consensus_queue.cc:260] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.022650 23034 ts_tablet_manager.cc:1428] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20250112 21:02:31.022715 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet b3248b954b544c6abc850dda72aaee00
I20250112 21:02:31.022835 23034 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.022962 22462 catalog_manager.cc:6596] ReplaceTablet: tablet b3248b954b544c6abc850dda72aaee00 deleted and replaced by tablet f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:31.023509 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (DEFAULT_TABLE table=default.Table_bf0165659b1547e2843f8ac01f667c83 [id=ac0d0569964b4de4bed1988303be50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.023680 22464 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]). Expected version 1 got 0
I20250112 21:02:31.023713 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bc4bbfe26c435a906dbf3312cc3d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.023777 23034 tablet_bootstrap.cc:654] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.025642 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 04616ed61b134e889503c3b336ad4054 (DEFAULT_TABLE table=default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.025873 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04616ed61b134e889503c3b336ad4054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.026310 23036 tablet_bootstrap.cc:492] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.026392 23036 ts_tablet_manager.cc:1397] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250112 21:02:31.026613 22464 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]). Expected version 1 got 0
I20250112 21:02:31.026708 22464 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]). Expected version 1 got 0
I20250112 21:02:31.026891 23036 raft_consensus.cc:357] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.026988 23036 raft_consensus.cc:383] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.027017 23036 raft_consensus.cc:738] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
W20250112 21:02:31.027108 22464 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1f164e6da7724fa8996766a41a0c214a consensus state has no leader
I20250112 21:02:31.027130 23036 consensus_queue.cc:260] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.027418 23036 ts_tablet_manager.cc:1428] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:31.027588 23036 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.028551 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (DEFAULT_TABLE table=default.Table_bf0165659b1547e2843f8ac01f667c83 [id=ac0d0569964b4de4bed1988303be50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.028777 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bc4bbfe26c435a906dbf3312cc3d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.028888 22898 tablet_service.cc:1467] Processing CreateTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.029100 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2faf8cc5d3604e7ab814be894c842fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.030437 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet abeeebb5039b4ca38450a0f727d1e0fd
I20250112 21:02:31.030450 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet bd45bb2c57a74ace9e09e89ee09cee30
I20250112 21:02:31.030910 22892 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce0379839924289921a2f75c986953a (DEFAULT_TABLE table=default.Table_950907394c814cf49909c3b8286c64af [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.031029 22457 catalog_manager.cc:6596] ReplaceTablet: tablet bd45bb2c57a74ace9e09e89ee09cee30 deleted and replaced by tablet 458bbc607af0400d93fe7990999d90b9
I20250112 21:02:31.031142 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce0379839924289921a2f75c986953a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.031302 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0e4f4b5f194bb99049fecc2b256b08 (DEFAULT_TABLE table=default.Table_0af1b886425c45f0b7e33eb26e8f2796 [id=aa1f07977f974c958523d83489ac64bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.031504 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0e4f4b5f194bb99049fecc2b256b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.031720 23036 tablet_bootstrap.cc:654] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.031965 22894 tablet_service.cc:1467] Processing CreateTablet for tablet f0f97254c55a47b5a5e96796ec18b049 (DEFAULT_TABLE table=default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.032161 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f97254c55a47b5a5e96796ec18b049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.033035 22893 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b (DEFAULT_TABLE table=default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.033246 22893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2e8bde44bc453fa202d8c81356ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.031147 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 04616ed61b134e889503c3b336ad4054 (DEFAULT_TABLE table=default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.034055 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04616ed61b134e889503c3b336ad4054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.035132 22891 tablet_service.cc:1467] Processing CreateTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd (DEFAULT_TABLE table=default.Table_19b0a72a5b4547e2925b2761711c4951 [id=a34fe8525b16448eb589cd0b380d1ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.035353 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeeebb5039b4ca38450a0f727d1e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.037173 22890 tablet_service.cc:1467] Processing CreateTablet for tablet d53dd4efde384b5d911f82e8d88326b8 (DEFAULT_TABLE table=default.Table_c9e9561973fb4223909807e9f1f6779b [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.037405 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53dd4efde384b5d911f82e8d88326b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.038980 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet b3248b954b544c6abc850dda72aaee00 with delete_type TABLET_DATA_DELETED (replaced by tablet f0aad32a4d5f40c69b28219f0cc42538) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.039139 23038 tablet_replica.cc:331] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.039261 23038 raft_consensus.cc:2238] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.039404 23038 raft_consensus.cc:2267] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.039431 23051 raft_consensus.cc:491] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.039510 23051 raft_consensus.cc:513] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.039892 23051 leader_election.cc:290] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.040283 23038 ts_tablet_manager.cc:1905] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.040561 23083 tablet.cc:1721] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.040907 23082 raft_consensus.cc:491] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.040995 23082 raft_consensus.cc:513] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.041348 23082 leader_election.cc:290] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.041412 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269be30c3f541c8a2531356e5f4fdc0" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.041525 22915 raft_consensus.cc:2463] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.042131 22582 leader_election.cc:304] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.042253 23038 ts_tablet_manager.cc:1918] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.042309 23038 log.cc:1198] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/b3248b954b544c6abc850dda72aaee00
I20250112 21:02:31.042310 23051 raft_consensus.cc:2798] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.042352 23051 raft_consensus.cc:491] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.042387 23051 raft_consensus.cc:3054] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.042552 23038 ts_tablet_manager.cc:1939] T b3248b954b544c6abc850dda72aaee00 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.042774 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_197cf0808f644f2aac394ec59f82d263" } modify_external_catalogs: true
I20250112 21:02:31.042879 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_197cf0808f644f2aac394ec59f82d263" } modify_external_catalogs: true
I20250112 21:02:31.043275 23051 raft_consensus.cc:513] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.043463 23303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250112 21:02:31.043589 23051 leader_election.cc:290] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.044164 23303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: Bootstrap complete.
I20250112 21:02:31.044320 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab7062bd844144599f4b80e82d6d80da" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.044456 22647 raft_consensus.cc:2463] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.044795 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269be30c3f541c8a2531356e5f4fdc0" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.044903 22780 raft_consensus.cc:3054] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.044900 22715 leader_election.cc:304] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.045809 22780 raft_consensus.cc:2463] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.045831 23082 raft_consensus.cc:2798] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.045867 23082 raft_consensus.cc:491] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.045898 23082 raft_consensus.cc:3054] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.046707 22622 tablet_service.cc:1467] Processing CreateTablet for tablet f0f97254c55a47b5a5e96796ec18b049 (DEFAULT_TABLE table=default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.046730 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b (DEFAULT_TABLE table=default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.046757 23082 raft_consensus.cc:513] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.046856 22627 tablet_service.cc:1467] Processing CreateTablet for tablet d53dd4efde384b5d911f82e8d88326b8 (DEFAULT_TABLE table=default.Table_c9e9561973fb4223909807e9f1f6779b [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.046918 22620 tablet_service.cc:1514] Processing DeleteTablet for tablet b3248b954b544c6abc850dda72aaee00 with delete_type TABLET_DATA_DELETED (replaced by tablet f0aad32a4d5f40c69b28219f0cc42538) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.046948 22622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f97254c55a47b5a5e96796ec18b049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.047065 23082 leader_election.cc:290] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.047307 22625 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce0379839924289921a2f75c986953a (DEFAULT_TABLE table=default.Table_950907394c814cf49909c3b8286c64af [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.047544 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet b3248b954b544c6abc850dda72aaee00 with delete_type TABLET_DATA_DELETED (replaced by tablet f0aad32a4d5f40c69b28219f0cc42538) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.047580 22624 tablet_service.cc:1467] Processing CreateTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd (DEFAULT_TABLE table=default.Table_19b0a72a5b4547e2925b2761711c4951 [id=a34fe8525b16448eb589cd0b380d1ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.047695 23039 tablet_replica.cc:331] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.047734 22758 tablet_service.cc:1467] Processing CreateTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd (DEFAULT_TABLE table=default.Table_19b0a72a5b4547e2925b2761711c4951 [id=a34fe8525b16448eb589cd0b380d1ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.047803 23039 raft_consensus.cc:2238] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.047921 23039 raft_consensus.cc:2267] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.047959 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeeebb5039b4ca38450a0f727d1e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.047971 22580 leader_election.cc:304] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.048151 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab7062bd844144599f4b80e82d6d80da" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.048233 22647 raft_consensus.cc:3054] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.048609 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b (DEFAULT_TABLE table=default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.048815 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2e8bde44bc453fa202d8c81356ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.049120 22647 raft_consensus.cc:2463] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.049343 23119 raft_consensus.cc:2798] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.049419 23119 raft_consensus.cc:695] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.049578 22715 leader_election.cc:304] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.049556 23119 consensus_queue.cc:237] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.050186 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269be30c3f541c8a2531356e5f4fdc0" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.050282 22781 raft_consensus.cc:2371] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1. Re-sending same reply.
I20250112 21:02:31.050769 22759 tablet_service.cc:1467] Processing CreateTablet for tablet d53dd4efde384b5d911f82e8d88326b8 (DEFAULT_TABLE table=default.Table_c9e9561973fb4223909807e9f1f6779b [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.050616 23303 raft_consensus.cc:357] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:31.050969 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53dd4efde384b5d911f82e8d88326b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.051025 23303 raft_consensus.cc:738] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81853a8db6f14748910205ef23843fa0, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.051056 23082 raft_consensus.cc:2798] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.051126 23082 raft_consensus.cc:695] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.051234 23082 consensus_queue.cc:237] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.051533 23303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:31.052803 23303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: configured and running, proceeding with master startup.
I20250112 21:02:31.052995 22466 master_service.cc:946] ReplaceTablet: received request to replace tablet 2b359497fc5d4d028c36b588410bf399 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.053479 23039 ts_tablet_manager.cc:1905] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.053815 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53dd4efde384b5d911f82e8d88326b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.055317 23039 ts_tablet_manager.cc:1918] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.055377 23039 log.cc:1198] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/b3248b954b544c6abc850dda72aaee00
I20250112 21:02:31.055612 23039 ts_tablet_manager.cc:1939] T b3248b954b544c6abc850dda72aaee00 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.055922 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce0379839924289921a2f75c986953a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.055975 22464 master_service.cc:946] ReplaceTablet: received request to replace tablet cd94918fa1384a56a246af2afd4a3aff from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.056320 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet b3248b954b544c6abc850dda72aaee00 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.056623 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0e4f4b5f194bb99049fecc2b256b08 (DEFAULT_TABLE table=default.Table_0af1b886425c45f0b7e33eb26e8f2796 [id=aa1f07977f974c958523d83489ac64bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.056833 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0e4f4b5f194bb99049fecc2b256b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.057598 22624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeeebb5039b4ca38450a0f727d1e0fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.059463 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e2e8bde44bc453fa202d8c81356ad3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.059672 23333 catalog_manager.cc:1260] Loaded cluster ID: b7211684857f4b4e9f02b932b4cfb770
I20250112 21:02:31.059715 23333 catalog_manager.cc:1553] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: loading cluster ID for follower catalog manager: success
I20250112 21:02:31.061573 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269be30c3f541c8a2531356e5f4fdc0" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.061695 22915 raft_consensus.cc:3054] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.061684 23118 raft_consensus.cc:491] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.061757 23118 raft_consensus.cc:513] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.062103 23118 leader_election.cc:290] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.062395 23333 catalog_manager.cc:1575] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: acquiring CA information for follower catalog manager: success
I20250112 21:02:31.062520 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287e9340b43a418791e5bcfe7e721720" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.062603 22915 raft_consensus.cc:2463] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.062640 22781 raft_consensus.cc:2463] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.062912 22580 leader_election.cc:304] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.063060 23118 raft_consensus.cc:2798] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.063102 23118 raft_consensus.cc:491] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.063134 23118 raft_consensus.cc:3054] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.063866 23118 raft_consensus.cc:513] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.063902 23333 catalog_manager.cc:1603] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250112 21:02:31.064169 23118 leader_election.cc:290] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.064605 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287e9340b43a418791e5bcfe7e721720" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.064725 22781 raft_consensus.cc:3054] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.065657 22781 raft_consensus.cc:2463] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.065796 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.065966 22466 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 2b359497fc5d4d028c36b588410bf399
I20250112 21:02:31.066026 22580 leader_election.cc:304] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.066215 22461 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61] alter complete (version 1)
I20250112 21:02:31.066222 22466 catalog_manager.cc:6596] ReplaceTablet: tablet 2b359497fc5d4d028c36b588410bf399 deleted and replaced by tablet 43b4420df3e84c1888043baa9f2dd692
I20250112 21:02:31.066411 22462 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d44d3f76b31747b784d209adf5c87d92" } modify_external_catalogs: true
I20250112 21:02:31.066515 22462 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d44d3f76b31747b784d209adf5c87d92" } modify_external_catalogs: true
I20250112 21:02:31.066551 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet cd94918fa1384a56a246af2afd4a3aff
I20250112 21:02:31.066774 22464 catalog_manager.cc:6596] ReplaceTablet: tablet cd94918fa1384a56a246af2afd4a3aff deleted and replaced by tablet 77617388a31447f196febf2980f3f410
I20250112 21:02:31.066893 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.067051 23040 tablet_replica.cc:331] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.067062 22890 tablet_service.cc:1514] Processing DeleteTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 with delete_type TABLET_DATA_DELETED (replaced by tablet 458bbc607af0400d93fe7990999d90b9) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.067193 23040 raft_consensus.cc:2238] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.067405 23040 raft_consensus.cc:2267] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.067672 22890 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.067795 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b359497fc5d4d028c36b588410bf399 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b4420df3e84c1888043baa9f2dd692) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.068025 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet b3248b954b544c6abc850dda72aaee00 (table default.Table_0126ff3f63db452aa29542957b7ddcbf [id=8ef8b7c86df94166b526d83a12e78cd5]) successfully deleted
I20250112 21:02:31.068106 22915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287e9340b43a418791e5bcfe7e721720" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.068225 22915 raft_consensus.cc:2463] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.068379 23049 raft_consensus.cc:2798] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.068481 23049 raft_consensus.cc:695] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.068588 23049 consensus_queue.cc:237] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.069013 23081 tablet.cc:1721] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.069079 23049 raft_consensus.cc:491] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.069136 23049 raft_consensus.cc:513] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.069419 23049 leader_election.cc:290] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.069156 22464 catalog_manager.cc:5526] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.069644 22918 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287e9340b43a418791e5bcfe7e721720" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.069679 22464 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 3 got 0
I20250112 21:02:31.069728 22918 raft_consensus.cc:3054] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.070248 23038 tablet_replica.cc:331] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.070382 23038 raft_consensus.cc:2238] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.070492 23038 raft_consensus.cc:2267] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.070536 22918 raft_consensus.cc:2463] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.070714 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab7062bd844144599f4b80e82d6d80da" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.070832 22917 raft_consensus.cc:2463] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.071242 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab7062bd844144599f4b80e82d6d80da" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.071337 22914 raft_consensus.cc:3054] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.071363 23134 raft_consensus.cc:491] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.071434 23134 raft_consensus.cc:513] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:31.071732 23134 leader_election.cc:290] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.072173 22914 raft_consensus.cc:2463] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.072353 23038 ts_tablet_manager.cc:1905] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.072489 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b359497fc5d4d028c36b588410bf399" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.072607 22780 raft_consensus.cc:2463] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.072605 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b359497fc5d4d028c36b588410bf399" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.072711 22647 raft_consensus.cc:2463] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.073350 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:31.073808 22582 leader_election.cc:343] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:31.074132 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet abeeebb5039b4ca38450a0f727d1e0fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abeeebb5039b4ca38450a0f727d1e0fd already in progress: creating tablet
I20250112 21:02:31.074505 23038 ts_tablet_manager.cc:1918] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.074582 23038 log.cc:1198] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/bd45bb2c57a74ace9e09e89ee09cee30
I20250112 21:02:31.074751 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet b3248b954b544c6abc850dda72aaee00 (table default.Table_0126ff3f63db452aa29542957b7ddcbf [id=8ef8b7c86df94166b526d83a12e78cd5]) successfully deleted
I20250112 21:02:31.074784 23038 ts_tablet_manager.cc:1939] T bd45bb2c57a74ace9e09e89ee09cee30 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.075767 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.075997 22623 tablet_service.cc:1514] Processing DeleteTablet for tablet cd94918fa1384a56a246af2afd4a3aff with delete_type TABLET_DATA_DELETED (replaced by tablet 77617388a31447f196febf2980f3f410) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.076133 22461 catalog_manager.cc:5526] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.076735 22622 tablet_service.cc:1514] Processing DeleteTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 with delete_type TABLET_DATA_DELETED (replaced by tablet 458bbc607af0400d93fe7990999d90b9) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.076726 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.076839 22781 raft_consensus.cc:2463] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.077217 22580 leader_election.cc:304] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.077427 23119 raft_consensus.cc:2798] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.077486 23119 raft_consensus.cc:491] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.077524 23119 raft_consensus.cc:3054] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.077493 22759 tablet_service.cc:1514] Processing DeleteTablet for tablet bd45bb2c57a74ace9e09e89ee09cee30 with delete_type TABLET_DATA_DELETED (replaced by tablet 458bbc607af0400d93fe7990999d90b9) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.077526 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.077646 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b359497fc5d4d028c36b588410bf399 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b4420df3e84c1888043baa9f2dd692) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.077831 22755 tablet_service.cc:1514] Processing DeleteTablet for tablet cd94918fa1384a56a246af2afd4a3aff with delete_type TABLET_DATA_DELETED (replaced by tablet 77617388a31447f196febf2980f3f410) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.077947 23039 tablet_replica.cc:331] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.078045 23039 raft_consensus.cc:2238] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.078140 23039 raft_consensus.cc:2267] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.078317 23040 ts_tablet_manager.cc:1905] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.078402 23119 raft_consensus.cc:513] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.078765 23119 leader_election.cc:290] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.079192 23039 ts_tablet_manager.cc:1905] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.079344 23038 tablet_replica.cc:331] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.079473 23038 raft_consensus.cc:2238] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.079566 23038 raft_consensus.cc:2267] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.079540 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.079841 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]) successfully deleted
W20250112 21:02:31.080013 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 1e2e8bde44bc453fa202d8c81356ad3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e2e8bde44bc453fa202d8c81356ad3b already in progress: creating tablet
I20250112 21:02:31.080037 23038 ts_tablet_manager.cc:1905] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.080799 22851 leader_election.cc:304] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
W20250112 21:02:31.080899 22851 raft_consensus.cc:2681] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250112 21:02:31.081393 23039 ts_tablet_manager.cc:1918] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.081459 23039 log.cc:1198] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/bd45bb2c57a74ace9e09e89ee09cee30
W20250112 21:02:31.081545 22582 leader_election.cc:343] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.081671 23039 ts_tablet_manager.cc:1939] T bd45bb2c57a74ace9e09e89ee09cee30 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.082270 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.082325 23039 tablet_replica.cc:331] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.082371 22781 raft_consensus.cc:3054] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.082448 23039 raft_consensus.cc:2238] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.082659 23039 raft_consensus.cc:2267] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.083235 23038 ts_tablet_manager.cc:1918] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.083161 22781 raft_consensus.cc:2463] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.083330 23038 log.cc:1198] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/2b359497fc5d4d028c36b588410bf399
I20250112 21:02:31.083346 23039 ts_tablet_manager.cc:1905] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.083549 23038 ts_tablet_manager.cc:1939] T 2b359497fc5d4d028c36b588410bf399 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.083568 22580 leader_election.cc:304] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.084177 23118 raft_consensus.cc:2798] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.084349 23118 raft_consensus.cc:695] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.084534 23118 consensus_queue.cc:237] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.085137 23039 ts_tablet_manager.cc:1918] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.085235 23039 log.cc:1198] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/2b359497fc5d4d028c36b588410bf399
I20250112 21:02:31.085420 23039 ts_tablet_manager.cc:1939] T 2b359497fc5d4d028c36b588410bf399 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.085937 23039 tablet_replica.cc:331] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.086050 23039 raft_consensus.cc:2238] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.086156 23039 raft_consensus.cc:2267] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.086233 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 2b359497fc5d4d028c36b588410bf399 (table default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]) successfully deleted
I20250112 21:02:31.086674 23039 ts_tablet_manager.cc:1905] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.088011 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.088663 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet cd94918fa1384a56a246af2afd4a3aff with delete_type TABLET_DATA_DELETED (replaced by tablet 77617388a31447f196febf2980f3f410) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.088949 23039 ts_tablet_manager.cc:1918] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.088996 23039 log.cc:1198] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/cd94918fa1384a56a246af2afd4a3aff
I20250112 21:02:31.088966 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 8a0e4f4b5f194bb99049fecc2b256b08 (DEFAULT_TABLE table=default.Table_0af1b886425c45f0b7e33eb26e8f2796 [id=aa1f07977f974c958523d83489ac64bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.089145 23039 ts_tablet_manager.cc:1939] T cd94918fa1384a56a246af2afd4a3aff P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.089219 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0e4f4b5f194bb99049fecc2b256b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.089897 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]). Expected version 1 got 0
I20250112 21:02:31.090003 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]). Expected version 1 got 0
I20250112 21:02:31.091166 22624 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.091338 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.091609 22757 tablet_service.cc:1467] Processing CreateTablet for tablet f0f97254c55a47b5a5e96796ec18b049 (DEFAULT_TABLE table=default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.091856 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f97254c55a47b5a5e96796ec18b049. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.091823 22466 catalog_manager.cc:5526] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.092007 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 2 got 0
I20250112 21:02:31.092121 22466 catalog_manager.cc:5526] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.092284 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]). Expected version 1 got 0
I20250112 21:02:31.094148 23084 tablet.cc:1721] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.094936 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (DEFAULT_TABLE table=default.Table_bf0165659b1547e2843f8ac01f667c83 [id=ac0d0569964b4de4bed1988303be50d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.095186 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82bc4bbfe26c435a906dbf3312cc3d5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:31.095194 22451 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet d53dd4efde384b5d911f82e8d88326b8 (table default.Table_c9e9561973fb4223909807e9f1f6779b [id=ba7360d4d2ea4e8d97026628ebd39bd9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d53dd4efde384b5d911f82e8d88326b8 consensus state has no leader
I20250112 21:02:31.097280 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b359497fc5d4d028c36b588410bf399 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b4420df3e84c1888043baa9f2dd692) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.097685 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 0ce0379839924289921a2f75c986953a (DEFAULT_TABLE table=default.Table_950907394c814cf49909c3b8286c64af [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.097929 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce0379839924289921a2f75c986953a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.099941 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.102977 22965 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:31.103087 22965 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
I20250112 21:02:31.103917 22694 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:31.104017 22694 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
I20250112 21:02:31.104512 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]) successfully deleted
W20250112 21:02:31.104671 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 1e2e8bde44bc453fa202d8c81356ad3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e2e8bde44bc453fa202d8c81356ad3b already in progress: creating tablet
I20250112 21:02:31.104768 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 2b359497fc5d4d028c36b588410bf399 (table default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]) successfully deleted
I20250112 21:02:31.104844 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
I20250112 21:02:31.106662 23051 raft_consensus.cc:491] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.106745 23051 raft_consensus.cc:513] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.106998 23264 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" instance_seqno: 1736715749206916) as {username='slave'} at 127.21.194.193:45215; Asking this server to re-register.
I20250112 21:02:31.107084 23051 leader_election.cc:290] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.107856 22780 raft_consensus.cc:1270] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.107885 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.108460 23051 consensus_queue.cc:1035] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.108608 22694 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:31.109180 22829 heartbeater.cc:346] Connected to a master server at 127.21.194.254:46215
I20250112 21:02:31.109292 22829 heartbeater.cc:502] Master 127.21.194.254:46215 was elected leader, sending a full tablet report...
I20250112 21:02:31.109325 23040 ts_tablet_manager.cc:1918] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.109393 23040 log.cc:1198] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/b3248b954b544c6abc850dda72aaee00
I20250112 21:02:31.109956 23040 ts_tablet_manager.cc:1939] T b3248b954b544c6abc850dda72aaee00 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.110265 22466 catalog_manager.cc:5526] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.110622 23040 tablet_replica.cc:331] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.110741 23040 raft_consensus.cc:2238] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.110899 23040 raft_consensus.cc:2267] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.111418 23040 ts_tablet_manager.cc:1905] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.111618 23263 ts_manager.cc:194] Registered new tserver with Master: d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.112066 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.112565 22914 raft_consensus.cc:1270] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250112 21:02:31.112875 22582 leader_election.cc:343] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.113410 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.113509 23264 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" instance_seqno: 1736715749372086) as {username='slave'} at 127.21.194.194:33309; Asking this server to re-register.
I20250112 21:02:31.113544 22781 raft_consensus.cc:2463] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.113907 23040 ts_tablet_manager.cc:1918] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.114120 22829 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:31.114172 23040 log.cc:1198] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/cd94918fa1384a56a246af2afd4a3aff
I20250112 21:02:31.114398 23040 ts_tablet_manager.cc:1939] T cd94918fa1384a56a246af2afd4a3aff P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.114688 22580 leader_election.cc:304] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.114899 23040 tablet_replica.cc:331] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.115011 23040 raft_consensus.cc:2238] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.115020 23118 raft_consensus.cc:2798] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.115075 23118 raft_consensus.cc:491] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.115105 23040 raft_consensus.cc:2267] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.115128 23118 raft_consensus.cc:3054] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.115695 23038 tablet_replica.cc:331] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.115819 23038 raft_consensus.cc:2238] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.115921 22621 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.115942 23038 raft_consensus.cc:2267] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.116120 23263 ts_manager.cc:194] Registered new tserver with Master: 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.116617 23038 ts_tablet_manager.cc:1905] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.116688 23034 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.116771 23034 ts_tablet_manager.cc:1397] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.094s user 0.000s sys 0.002s
I20250112 21:02:31.116909 23118 raft_consensus.cc:513] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.117236 23118 leader_election.cc:290] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.117206 23034 raft_consensus.cc:357] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.117329 23034 raft_consensus.cc:383] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.117375 23034 raft_consensus.cc:738] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.117501 23034 consensus_queue.cc:260] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.117767 23034 ts_tablet_manager.cc:1428] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.117933 23034 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.118602 23038 ts_tablet_manager.cc:1918] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.118667 23038 log.cc:1198] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/cd94918fa1384a56a246af2afd4a3aff
I20250112 21:02:31.118875 23034 tablet_bootstrap.cc:654] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.118886 23038 ts_tablet_manager.cc:1939] T cd94918fa1384a56a246af2afd4a3aff P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.118939 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:31.119275 22582 leader_election.cc:343] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.119879 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet b3248b954b544c6abc850dda72aaee00 with delete_type TABLET_DATA_DELETED (replaced by tablet f0aad32a4d5f40c69b28219f0cc42538) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.113873 23119 consensus_queue.cc:1035] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.121392 23037 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.121485 23037 ts_tablet_manager.cc:1397] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.000s
I20250112 21:02:31.121549 23034 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.121623 23034 ts_tablet_manager.cc:1397] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20250112 21:02:31.121752 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet b3248b954b544c6abc850dda72aaee00 (table default.Table_0126ff3f63db452aa29542957b7ddcbf [id=8ef8b7c86df94166b526d83a12e78cd5]) successfully deleted
I20250112 21:02:31.121954 23037 raft_consensus.cc:357] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.122040 23037 raft_consensus.cc:383] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250112 21:02:31.122015 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet abeeebb5039b4ca38450a0f727d1e0fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abeeebb5039b4ca38450a0f727d1e0fd already in progress: creating tablet
I20250112 21:02:31.122071 23037 raft_consensus.cc:738] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.122017 23034 raft_consensus.cc:357] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.122130 23034 raft_consensus.cc:383] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.122166 23034 raft_consensus.cc:738] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.122174 23037 consensus_queue.cc:260] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.122226 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
I20250112 21:02:31.122265 23034 consensus_queue.cc:260] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.122434 23037 ts_tablet_manager.cc:1428] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.122543 23034 ts_tablet_manager.cc:1428] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.122622 23037 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.122687 23034 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.123520 23037 tablet_bootstrap.cc:654] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.123574 23034 tablet_bootstrap.cc:654] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.123737 23258 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "3423673c659e4427958b13fc9eaa714d" instance_seqno: 1736715749546217) as {username='slave'} at 127.21.194.195:52301; Asking this server to re-register.
I20250112 21:02:31.124302 23040 ts_tablet_manager.cc:1905] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.120244 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.124480 22780 raft_consensus.cc:3054] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.124840 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet cd94918fa1384a56a246af2afd4a3aff (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]) successfully deleted
W20250112 21:02:31.124984 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 04616ed61b134e889503c3b336ad4054 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04616ed61b134e889503c3b336ad4054 already in progress: creating tablet
I20250112 21:02:31.125362 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_2ab7b7c9de6a4ef0af72a85800f3a067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.125437 22780 raft_consensus.cc:2463] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.125727 22580 leader_election.cc:304] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
W20250112 21:02:31.125777 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ab7b7c9de6a4ef0af72a85800f3a067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.126564 22965 heartbeater.cc:463] Registering TS with master...
I20250112 21:02:31.126680 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_44a18784001e45b3a8c92835db52640c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.126963 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44a18784001e45b3a8c92835db52640c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.127615 23051 raft_consensus.cc:2798] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.127641 22457 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c5f83956bcdb4c078af6d6f0370a5d3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.127708 23051 raft_consensus.cc:695] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.127816 23051 consensus_queue.cc:237] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
W20250112 21:02:31.127892 22457 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5f83956bcdb4c078af6d6f0370a5d3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250112 21:02:31.128234 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet abeeebb5039b4ca38450a0f727d1e0fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abeeebb5039b4ca38450a0f727d1e0fd already in progress: creating tablet
W20250112 21:02:31.128358 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 04616ed61b134e889503c3b336ad4054 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04616ed61b134e889503c3b336ad4054 already in progress: creating tablet
W20250112 21:02:31.128857 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet b3248b954b544c6abc850dda72aaee00 because the tablet was not found. No further retry: Not found: Tablet not found: b3248b954b544c6abc850dda72aaee00
I20250112 21:02:31.130539 23264 ts_manager.cc:194] Registered new tserver with Master: 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.134317 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 3 got 0
I20250112 21:02:31.135386 22460 catalog_manager.cc:5526] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:31.135589 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:31.136588 23083 tablet.cc:1721] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.137290 23149 tablet.cc:1721] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.137727 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 3 got 0
I20250112 21:02:31.141266 23037 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.141355 23037 ts_tablet_manager.cc:1397] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20250112 21:02:31.141796 23037 raft_consensus.cc:357] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.141883 23037 raft_consensus.cc:383] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.141912 23037 raft_consensus.cc:738] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.142020 23037 consensus_queue.cc:260] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.142303 23037 ts_tablet_manager.cc:1428] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.142336 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 5269be30c3f541c8a2531356e5f4fdc0 (table default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248]). Expected version 3 got 0
I20250112 21:02:31.142464 23037 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.143386 23037 tablet_bootstrap.cc:654] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.143317 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_55525039c39c4f39b6f415812ca5875e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.143675 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55525039c39c4f39b6f415812ca5875e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.144833 22781 raft_consensus.cc:1270] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.144840 22782 raft_consensus.cc:1270] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.145119 22916 raft_consensus.cc:1270] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.145382 23118 consensus_queue.cc:1035] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.145444 23049 consensus_queue.cc:1035] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:31.145974 22582 consensus_peers.cc:487] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea -> Peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Couldn't send request to peer 3423673c659e4427958b13fc9eaa714d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.146142 23119 consensus_queue.cc:1035] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.148937 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]). Expected version 2 got 0
I20250112 21:02:31.150626 23083 tablet.cc:1716] T 5269be30c3f541c8a2531356e5f4fdc0 P d8faec3969b64c33a4bf9aba509785ea: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:31.150903 23083 tablet.cc:1721] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.151043 23149 tablet.cc:1716] T 5269be30c3f541c8a2531356e5f4fdc0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:31.152292 23149 tablet.cc:1721] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.156213 23040 ts_tablet_manager.cc:1918] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.156781 23040 log.cc:1198] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/bd45bb2c57a74ace9e09e89ee09cee30
I20250112 21:02:31.157069 23040 ts_tablet_manager.cc:1939] T bd45bb2c57a74ace9e09e89ee09cee30 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.157850 23034 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.157941 23034 ts_tablet_manager.cc:1397] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.000s
I20250112 21:02:31.158028 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet bd45bb2c57a74ace9e09e89ee09cee30 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]) successfully deleted
I20250112 21:02:31.158377 23034 raft_consensus.cc:357] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.158481 23034 raft_consensus.cc:383] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250112 21:02:31.158494 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 1e2e8bde44bc453fa202d8c81356ad3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e2e8bde44bc453fa202d8c81356ad3b already in progress: creating tablet
I20250112 21:02:31.158526 23034 raft_consensus.cc:738] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.158639 23034 consensus_queue.cc:260] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.158910 23034 ts_tablet_manager.cc:1428] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.159101 23034 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.159091 23084 tablet.cc:1721] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.159348 23322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:31.159477 23322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:31.160018 23034 tablet_bootstrap.cc:654] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.160452 23040 tablet_replica.cc:331] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.160634 23040 raft_consensus.cc:2238] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.160778 23040 raft_consensus.cc:2267] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.161746 23034 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.161823 23034 ts_tablet_manager.cc:1397] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:31.162242 23034 raft_consensus.cc:357] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.162334 23034 raft_consensus.cc:383] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.162365 23034 raft_consensus.cc:738] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.162472 23034 consensus_queue.cc:260] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.163046 23049 raft_consensus.cc:491] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.163121 23049 raft_consensus.cc:513] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.163448 23049 leader_election.cc:290] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.163667 23036 tablet_bootstrap.cc:492] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.163763 23036 ts_tablet_manager.cc:1397] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.136s user 0.002s sys 0.000s
I20250112 21:02:31.164496 23083 tablet.cc:1721] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.164623 23036 raft_consensus.cc:357] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.164729 23036 raft_consensus.cc:383] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.164759 23036 raft_consensus.cc:738] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.164995 23036 consensus_queue.cc:260] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.165267 23036 ts_tablet_manager.cc:1428] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.165437 23036 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.166462 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282486f313de4e99ae57aff652e29b66" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.166572 22782 raft_consensus.cc:2463] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.166805 23034 ts_tablet_manager.cc:1428] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:31.166958 23034 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.167399 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282486f313de4e99ae57aff652e29b66" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.167522 22580 leader_election.cc:304] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.168419 23119 raft_consensus.cc:2798] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.168485 23119 raft_consensus.cc:491] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.168496 23034 tablet_bootstrap.cc:654] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.168525 23119 raft_consensus.cc:3054] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.169445 23034 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.169404 23119 raft_consensus.cc:513] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.169512 23034 ts_tablet_manager.cc:1397] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250112 21:02:31.169744 23119 leader_election.cc:290] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.169904 23034 raft_consensus.cc:357] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.170010 23034 raft_consensus.cc:383] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.170043 23034 raft_consensus.cc:738] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.170157 23034 consensus_queue.cc:260] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.170418 23034 ts_tablet_manager.cc:1428] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.170468 23149 tablet.cc:1721] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.170569 23034 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:31.171494 22582 leader_election.cc:343] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.171561 23034 tablet_bootstrap.cc:654] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.172125 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282486f313de4e99ae57aff652e29b66" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.173398 22459 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_950907394c814cf49909c3b8286c64af" } new_table_name: "default.Table_c46e41e9bbd5419496479d9a2b69e46c" modify_external_catalogs: true
I20250112 21:02:31.173944 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "282486f313de4e99ae57aff652e29b66" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.174038 22782 raft_consensus.cc:3054] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.174274 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.174602 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.174983 22782 raft_consensus.cc:2463] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.175240 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_b44cd661c42a45b480baa1ea160d909f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.175559 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b44cd661c42a45b480baa1ea160d909f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.175741 23034 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.175701 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_e1696bafd2c7402ca2222344c4db901d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.175815 23034 ts_tablet_manager.cc:1397] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
W20250112 21:02:31.175982 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1696bafd2c7402ca2222344c4db901d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.176234 23034 raft_consensus.cc:357] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.176332 23034 raft_consensus.cc:383] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.176369 23034 raft_consensus.cc:738] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.176489 23034 consensus_queue.cc:260] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.176612 22580 leader_election.cc:304] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.176752 23034 ts_tablet_manager.cc:1428] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20250112 21:02:31.176833 22582 leader_election.cc:343] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.176913 23034 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.177089 23049 raft_consensus.cc:2798] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.177167 23049 raft_consensus.cc:695] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.177284 23049 consensus_queue.cc:237] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.177804 23034 tablet_bootstrap.cc:654] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.177803 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_64fb8ef7b3f643399a091c234bcd8e67" } new_table_name: "default.Table_61803d2edd2e4cb0965b9b9cc1c8f9e4" modify_external_catalogs: true
I20250112 21:02:31.180482 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f5d73d2eb66444888ba1c47a516b5da4" } new_table_name: "default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c" modify_external_catalogs: true
I20250112 21:02:31.181469 23034 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.181546 23034 ts_tablet_manager.cc:1397] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250112 21:02:31.181797 23036 tablet_bootstrap.cc:654] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.181936 23034 raft_consensus.cc:357] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.182024 23034 raft_consensus.cc:383] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.182049 23034 raft_consensus.cc:738] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.182173 23034 consensus_queue.cc:260] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.182435 23034 ts_tablet_manager.cc:1428] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.182601 23034 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.183472 23034 tablet_bootstrap.cc:654] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.184916 23034 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.184996 23034 ts_tablet_manager.cc:1397] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.185418 23034 raft_consensus.cc:357] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.185513 23034 raft_consensus.cc:383] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.185542 23034 raft_consensus.cc:738] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.185645 23034 consensus_queue.cc:260] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.185894 23034 ts_tablet_manager.cc:1428] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.186041 23034 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.187050 23034 tablet_bootstrap.cc:654] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.188681 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c72dd11f1a2d442da8125f20836b4a2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.189018 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72dd11f1a2d442da8125f20836b4a2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.189285 23034 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.189353 23034 ts_tablet_manager.cc:1397] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:31.189744 23034 raft_consensus.cc:357] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.189829 23034 raft_consensus.cc:383] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.189857 23034 raft_consensus.cc:738] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.189963 23034 consensus_queue.cc:260] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.190224 23034 ts_tablet_manager.cc:1428] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.190372 23034 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.191231 23034 tablet_bootstrap.cc:654] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.191794 23356 tablet.cc:1721] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.193146 23034 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.193236 23034 ts_tablet_manager.cc:1397] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:31.193645 23034 raft_consensus.cc:357] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.193743 23034 raft_consensus.cc:383] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.193776 23034 raft_consensus.cc:738] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.193878 23034 consensus_queue.cc:260] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.193958 22464 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_b0c1845fae724ad2b951fc8c1909b011 [id=e486d872e93743d4b75ed5d3a6ec9248] alter complete (version 3)
I20250112 21:02:31.194129 23034 ts_tablet_manager.cc:1428] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:31.198015 22464 catalog_manager.cc:5526] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.199246 22463 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c9e9561973fb4223909807e9f1f6779b" } new_table_name: "default.Table_77196fc27b3c43a18dc33dedc28330e0" modify_external_catalogs: true
I20250112 21:02:31.201558 23040 ts_tablet_manager.cc:1905] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.203295 23040 ts_tablet_manager.cc:1918] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.203363 23040 log.cc:1198] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/2b359497fc5d4d028c36b588410bf399
I20250112 21:02:31.203522 23040 ts_tablet_manager.cc:1939] T 2b359497fc5d4d028c36b588410bf399 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.204380 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 2b359497fc5d4d028c36b588410bf399 (table default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]) successfully deleted
W20250112 21:02:31.204607 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 04616ed61b134e889503c3b336ad4054 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04616ed61b134e889503c3b336ad4054 already in progress: creating tablet
I20250112 21:02:31.207105 23084 tablet.cc:1716] T 5269be30c3f541c8a2531356e5f4fdc0 P 3423673c659e4427958b13fc9eaa714d: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:31.209342 23037 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.209432 23037 ts_tablet_manager.cc:1397] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.000s
I20250112 21:02:31.209883 23037 raft_consensus.cc:357] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.209980 23037 raft_consensus.cc:383] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.210031 23037 raft_consensus.cc:738] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.210139 23037 consensus_queue.cc:260] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.210394 23037 ts_tablet_manager.cc:1428] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.210572 23037 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.211740 23037 tablet_bootstrap.cc:654] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.212817 23037 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.213852 23036 tablet_bootstrap.cc:492] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.213946 23036 ts_tablet_manager.cc:1397] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20250112 21:02:31.214414 23036 raft_consensus.cc:357] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.214531 23036 raft_consensus.cc:383] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.214537 23037 ts_tablet_manager.cc:1397] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:31.214562 23036 raft_consensus.cc:738] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.214700 23036 consensus_queue.cc:260] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.214988 23036 ts_tablet_manager.cc:1428] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.214975 23037 raft_consensus.cc:357] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.215093 23037 raft_consensus.cc:383] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.215127 23037 raft_consensus.cc:738] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.215258 23037 consensus_queue.cc:260] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.215569 23037 ts_tablet_manager.cc:1428] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.215736 23037 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.216851 23036 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.216675 23037 tablet_bootstrap.cc:654] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.217741 23036 tablet_bootstrap.cc:654] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.219374 23119 raft_consensus.cc:491] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.219466 23119 raft_consensus.cc:513] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.219817 23119 leader_election.cc:290] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.220238 23135 consensus_queue.cc:1035] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.220268 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.220329 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.220495 22782 raft_consensus.cc:2463] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
W20250112 21:02:31.220588 22582 leader_election.cc:343] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.220835 22580 leader_election.cc:304] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.221176 23119 raft_consensus.cc:2798] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.221237 23119 raft_consensus.cc:491] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.221285 23119 raft_consensus.cc:3054] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.222155 23119 raft_consensus.cc:513] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.222455 23119 leader_election.cc:290] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.222847 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.222972 22782 raft_consensus.cc:3054] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.223158 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:31.223596 22582 leader_election.cc:343] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.223954 22782 raft_consensus.cc:2463] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.224557 22580 leader_election.cc:304] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.224797 23119 raft_consensus.cc:2798] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.224864 23119 raft_consensus.cc:695] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.224967 23119 consensus_queue.cc:237] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.227934 23226 consensus_queue.cc:1035] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.230964 23036 tablet_bootstrap.cc:492] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.231056 23036 ts_tablet_manager.cc:1397] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20250112 21:02:31.231684 23036 raft_consensus.cc:357] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.231776 23036 raft_consensus.cc:383] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.231804 23036 raft_consensus.cc:738] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.231907 23036 consensus_queue.cc:260] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.232856 23036 ts_tablet_manager.cc:1428] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.233103 23036 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.234050 23036 tablet_bootstrap.cc:654] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.235965 23036 tablet_bootstrap.cc:492] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.237021 23036 ts_tablet_manager.cc:1397] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:31.237524 23036 raft_consensus.cc:357] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.237680 23036 raft_consensus.cc:383] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.237747 23036 raft_consensus.cc:738] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.237928 23036 consensus_queue.cc:260] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.238570 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_6dca3743bd384f20844603fc314e151f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.238777 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f190315f79014ff7b36f19c8a586e1f9" } modify_external_catalogs: true
I20250112 21:02:31.238890 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_f190315f79014ff7b36f19c8a586e1f9" } modify_external_catalogs: true
W20250112 21:02:31.238934 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6dca3743bd384f20844603fc314e151f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.239796 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_805fe24f44d64d60ad6655a1ae8a0027" } modify_external_catalogs: true
I20250112 21:02:31.239892 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_805fe24f44d64d60ad6655a1ae8a0027" } modify_external_catalogs: true
I20250112 21:02:31.240736 22647 raft_consensus.cc:1270] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.240924 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_d90a9cd4efd54c5fae3e012693cea10a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.241212 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90a9cd4efd54c5fae3e012693cea10a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.241338 23036 ts_tablet_manager.cc:1428] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:31.242480 22917 raft_consensus.cc:1270] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.242704 23036 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.243757 23036 tablet_bootstrap.cc:654] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.244975 23036 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.244942 23082 consensus_queue.cc:1035] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.245046 23036 ts_tablet_manager.cc:1397] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.245445 23036 raft_consensus.cc:357] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.245546 23036 raft_consensus.cc:383] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.245574 23036 raft_consensus.cc:738] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.245556 23082 consensus_queue.cc:1035] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.245682 23036 consensus_queue.cc:260] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.245930 23036 ts_tablet_manager.cc:1428] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.246078 23036 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.246964 23036 tablet_bootstrap.cc:654] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.249953 23354 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.250685 23149 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.251793 23084 tablet.cc:1721] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.256783 23354 tablet.cc:1721] T ab7062bd844144599f4b80e82d6d80da P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.257814 22460 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_fbc86351fd1f4869bdb002b6fe76ba8f" } new_table_name: "default.Table_3ec39e98832645acb9cc15e604392112" modify_external_catalogs: true
I20250112 21:02:31.261871 23149 tablet.cc:1721] T ab7062bd844144599f4b80e82d6d80da P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.262678 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 79d16ad34f414aa6bfba934463afef73
I20250112 21:02:31.263052 22461 master_service.cc:946] ReplaceTablet: received request to replace tablet 5a252d2647f84d9aaac1fc26f0de81b0 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.263777 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet cfdd98834d4048e08c912c17bcb82674
I20250112 21:02:31.263898 22458 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_75dbe00b4ac144fda1277b451c425944" } modify_external_catalogs: true
I20250112 21:02:31.264000 22458 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_75dbe00b4ac144fda1277b451c425944" } modify_external_catalogs: true
I20250112 21:02:31.264119 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet 8fe1bc020af84f039e1560c7ae4f9176 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.264302 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet d53dd4efde384b5d911f82e8d88326b8 (table default.Table_c9e9561973fb4223909807e9f1f6779b [id=ba7360d4d2ea4e8d97026628ebd39bd9]). Expected version 1 got 0
I20250112 21:02:31.264626 22621 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d16ad34f414aa6bfba934463afef73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.264688 22465 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:31.264796 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d16ad34f414aa6bfba934463afef73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.264931 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdd98834d4048e08c912c17bcb82674 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.265058 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdd98834d4048e08c912c17bcb82674 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.265209 23039 tablet_replica.cc:331] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.265345 23039 raft_consensus.cc:2238] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.265447 23039 raft_consensus.cc:2267] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:31.265535 22459 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0ce0379839924289921a2f75c986953a consensus state has no leader
W20250112 21:02:31.265862 22463 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d53dd4efde384b5d911f82e8d88326b8 consensus state has no leader
I20250112 21:02:31.266072 23040 tablet_replica.cc:331] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.266186 23040 raft_consensus.cc:2238] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.266346 23040 pending_rounds.cc:62] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:31.266377 23040 pending_rounds.cc:69] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715917381632 op_type: NO_OP noop_request { }
I20250112 21:02:31.266431 23040 raft_consensus.cc:2883] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.266479 23040 raft_consensus.cc:2267] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.267232 23039 ts_tablet_manager.cc:1905] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.268240 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 79d16ad34f414aa6bfba934463afef73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.268496 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet cfdd98834d4048e08c912c17bcb82674 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.268553 22463 master_service.cc:946] ReplaceTablet: received request to replace tablet 11f19de7823b40c1ba7ed03d2d8adfcd from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.268509 23038 tablet_replica.cc:331] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.268766 23226 raft_consensus.cc:491] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.268831 23038 raft_consensus.cc:2238] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.268867 23226 raft_consensus.cc:513] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.268924 23038 raft_consensus.cc:2267] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.269407 23038 ts_tablet_manager.cc:1905] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.269647 23039 ts_tablet_manager.cc:1918] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.269717 23039 log.cc:1198] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/79d16ad34f414aa6bfba934463afef73
I20250112 21:02:31.269748 23226 leader_election.cc:290] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.269913 23039 ts_tablet_manager.cc:1939] T 79d16ad34f414aa6bfba934463afef73 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.270231 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.270632 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 79d16ad34f414aa6bfba934463afef73 (table default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]) successfully deleted
I20250112 21:02:31.271034 23036 tablet_bootstrap.cc:492] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.271122 23036 ts_tablet_manager.cc:1397] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20250112 21:02:31.271420 23038 ts_tablet_manager.cc:1918] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.271488 23038 log.cc:1198] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/79d16ad34f414aa6bfba934463afef73
I20250112 21:02:31.271611 23036 raft_consensus.cc:357] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.271716 23036 raft_consensus.cc:383] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.271746 23036 raft_consensus.cc:738] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.271855 23036 consensus_queue.cc:260] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.272104 23036 ts_tablet_manager.cc:1428] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:31.272222 23041 raft_consensus.cc:491] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.272254 23039 tablet_replica.cc:331] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.272281 23036 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.272296 23041 raft_consensus.cc:513] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.272378 23039 raft_consensus.cc:2238] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.272591 23039 raft_consensus.cc:2267] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.272675 23041 leader_election.cc:290] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.273241 23036 tablet_bootstrap.cc:654] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.273710 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53dd4efde384b5d911f82e8d88326b8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.273844 22647 raft_consensus.cc:2463] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.274284 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "159ed04aaf0447ad9b016d39f3271aaf" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.274794 23040 ts_tablet_manager.cc:1905] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.275020 23039 ts_tablet_manager.cc:1905] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.277056 23039 ts_tablet_manager.cc:1918] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.277119 23039 log.cc:1198] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/cfdd98834d4048e08c912c17bcb82674
I20250112 21:02:31.277144 23040 ts_tablet_manager.cc:1918] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.277208 23040 log.cc:1198] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/79d16ad34f414aa6bfba934463afef73
I20250112 21:02:31.277359 23039 ts_tablet_manager.cc:1939] T cfdd98834d4048e08c912c17bcb82674 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.277429 23040 ts_tablet_manager.cc:1939] T 79d16ad34f414aa6bfba934463afef73 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.277959 23040 tablet_replica.cc:331] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.278074 23040 raft_consensus.cc:2238] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.278170 23040 raft_consensus.cc:2267] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.278357 22459 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3f4664e903e641f49a309dfa855e3266" } modify_external_catalogs: true
I20250112 21:02:31.278482 22459 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3f4664e903e641f49a309dfa855e3266" } modify_external_catalogs: true
I20250112 21:02:31.278967 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 79d16ad34f414aa6bfba934463afef73 (table default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]) successfully deleted
I20250112 21:02:31.279198 22851 leader_election.cc:304] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.279405 23134 raft_consensus.cc:491] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.279476 23134 raft_consensus.cc:513] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.279820 23134 leader_election.cc:290] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.279894 23134 raft_consensus.cc:2743] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.280669 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc4bbfe26c435a906dbf3312cc3d5a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.280799 22782 raft_consensus.cc:2463] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.280829 23041 raft_consensus.cc:491] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.280907 23041 raft_consensus.cc:513] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.281258 23041 leader_election.cc:290] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.281874 23037 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.281963 23037 ts_tablet_manager.cc:1397] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20250112 21:02:31.282486 23037 raft_consensus.cc:357] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.282583 23037 raft_consensus.cc:383] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.282613 23037 raft_consensus.cc:738] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.282588 22851 leader_election.cc:304] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:31.282724 23037 consensus_queue.cc:260] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.282984 23037 ts_tablet_manager.cc:1428] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.283133 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc4bbfe26c435a906dbf3312cc3d5a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.283182 23037 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.283980 23134 raft_consensus.cc:2798] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.284035 23134 raft_consensus.cc:491] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.284070 23134 raft_consensus.cc:3054] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.284096 23037 tablet_bootstrap.cc:654] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.285056 23134 raft_consensus.cc:513] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.285158 23037 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.285240 23037 ts_tablet_manager.cc:1397] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:31.285395 23134 leader_election.cc:290] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.285678 23037 raft_consensus.cc:357] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.285768 23037 raft_consensus.cc:383] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.285792 23037 raft_consensus.cc:738] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.285837 22917 raft_consensus.cc:3054] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.285894 23037 consensus_queue.cc:260] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.286134 23037 ts_tablet_manager.cc:1428] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.286293 23037 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.286715 22917 raft_consensus.cc:1270] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.287117 22460 master_service.cc:946] ReplaceTablet: received request to replace tablet d53dd4efde384b5d911f82e8d88326b8 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.287125 23119 consensus_queue.cc:1035] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.287763 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet 8fe1bc020af84f039e1560c7ae4f9176 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.288373 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]) successfully deleted
I20250112 21:02:31.280689 22715 leader_election.cc:304] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.291316 22782 raft_consensus.cc:1270] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.291563 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53dd4efde384b5d911f82e8d88326b8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.291785 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f164e6da7724fa8996766a41a0c214a" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.291872 22916 raft_consensus.cc:2463] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.292161 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc4bbfe26c435a906dbf3312cc3d5a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.292260 22782 raft_consensus.cc:3054] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.292563 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 5a252d2647f84d9aaac1fc26f0de81b0
I20250112 21:02:31.292811 22461 catalog_manager.cc:6596] ReplaceTablet: tablet 5a252d2647f84d9aaac1fc26f0de81b0 deleted and replaced by tablet 32063752131c417abd32c5f0a8400adc
I20250112 21:02:31.292982 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_02d4dc14615749259db8519e1657df57" } modify_external_catalogs: true
I20250112 21:02:31.293073 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_02d4dc14615749259db8519e1657df57" } modify_external_catalogs: true
I20250112 21:02:31.293241 22782 raft_consensus.cc:2463] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:31.293754 22464 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba] alter complete (version 1)
I20250112 21:02:31.293905 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 32063752131c417abd32c5f0a8400adc) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.294044 22851 leader_election.cc:304] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
W20250112 21:02:31.294426 22851 leader_election.cc:343] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.294579 23036 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.294610 23135 raft_consensus.cc:2798] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.294662 23036 ts_tablet_manager.cc:1397] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20250112 21:02:31.294706 23046 consensus_queue.cc:1035] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.294833 23039 tablet_replica.cc:331] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.294942 23039 raft_consensus.cc:2238] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.294934 23046 consensus_queue.cc:1035] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.295030 23039 raft_consensus.cc:2267] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.295166 23036 raft_consensus.cc:357] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.295248 23036 raft_consensus.cc:383] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.295274 23036 raft_consensus.cc:738] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.295362 23039 ts_tablet_manager.cc:1905] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.295382 23036 consensus_queue.cc:260] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.295526 23084 tablet.cc:1721] T ab7062bd844144599f4b80e82d6d80da P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.295637 23036 ts_tablet_manager.cc:1428] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.295784 23036 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:31.296000 22717 leader_election.cc:343] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.296186 22717 leader_election.cc:304] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:31.296324 23082 raft_consensus.cc:2798] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.296363 23082 raft_consensus.cc:491] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.296459 23082 raft_consensus.cc:3054] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.296715 23036 tablet_bootstrap.cc:654] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.297356 23082 raft_consensus.cc:513] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.294672 23135 raft_consensus.cc:695] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:31.297531 23039 ts_tablet_manager.cc:1918] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.297531 23135 consensus_queue.cc:237] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.297590 23039 log.cc:1198] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/5a252d2647f84d9aaac1fc26f0de81b0
I20250112 21:02:31.297685 23082 leader_election.cc:290] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.297772 23039 ts_tablet_manager.cc:1939] T 5a252d2647f84d9aaac1fc26f0de81b0 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.293740 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 32063752131c417abd32c5f0a8400adc) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.293745 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bc4bbfe26c435a906dbf3312cc3d5a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.293344 23040 ts_tablet_manager.cc:1905] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.300271 23119 raft_consensus.cc:491] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.300302 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53dd4efde384b5d911f82e8d88326b8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.300387 22646 raft_consensus.cc:3054] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.300347 23119 raft_consensus.cc:513] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.300769 23119 leader_election.cc:290] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.301137 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0f97254c55a47b5a5e96796ec18b049" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.301216 22646 raft_consensus.cc:2463] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.300427 23051 consensus_queue.cc:1035] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:31.301621 22582 leader_election.cc:343] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.301653 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a252d2647f84d9aaac1fc26f0de81b0 with delete_type TABLET_DATA_DELETED (replaced by tablet 32063752131c417abd32c5f0a8400adc) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.301682 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f164e6da7724fa8996766a41a0c214a" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.301779 22647 raft_consensus.cc:2463] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.297771 23082 raft_consensus.cc:2798] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.301955 23082 raft_consensus.cc:491] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.302001 23082 raft_consensus.cc:3054] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.302140 22715 leader_election.cc:304] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.302611 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0f97254c55a47b5a5e96796ec18b049" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.302709 22781 raft_consensus.cc:2463] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.302819 23082 raft_consensus.cc:513] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.303114 23082 leader_election.cc:290] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.302845 23065 raft_consensus.cc:2798] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.303287 23065 raft_consensus.cc:695] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.303404 23065 consensus_queue.cc:237] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.305220 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 5a252d2647f84d9aaac1fc26f0de81b0 (table default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]) successfully deleted
I20250112 21:02:31.306422 22580 leader_election.cc:304] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.306646 23051 raft_consensus.cc:2798] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.306694 23051 raft_consensus.cc:491] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.306728 23051 raft_consensus.cc:3054] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.307567 23051 raft_consensus.cc:513] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.307883 23051 leader_election.cc:290] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.308249 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0f97254c55a47b5a5e96796ec18b049" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:31.308580 22582 leader_election.cc:343] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.308894 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f164e6da7724fa8996766a41a0c214a" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.308986 22647 raft_consensus.cc:3054] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.309713 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 8fe1bc020af84f039e1560c7ae4f9176
I20250112 21:02:31.309772 22647 raft_consensus.cc:2463] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.309974 22457 catalog_manager.cc:6596] ReplaceTablet: tablet 8fe1bc020af84f039e1560c7ae4f9176 deleted and replaced by tablet 7d5332ec945740f0a998b1fb9848387a
I20250112 21:02:31.310341 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5332ec945740f0a998b1fb9848387a) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:31.310832 22851 leader_election.cc:343] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.310855 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5332ec945740f0a998b1fb9848387a) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.311410 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f164e6da7724fa8996766a41a0c214a" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.311518 22914 raft_consensus.cc:3054] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.311693 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d53dd4efde384b5d911f82e8d88326b8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.312181 23082 raft_consensus.cc:491] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.312193 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 8fe1bc020af84f039e1560c7ae4f9176 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d5332ec945740f0a998b1fb9848387a) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.312270 23082 raft_consensus.cc:513] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.312359 23039 tablet_replica.cc:331] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.312507 23039 raft_consensus.cc:2238] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.312597 23082 leader_election.cc:290] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.312639 23039 pending_rounds.cc:62] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:31.312673 23039 pending_rounds.cc:69] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715840536576 op_type: NO_OP noop_request { }
I20250112 21:02:31.312721 23039 raft_consensus.cc:2883] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.312765 23039 raft_consensus.cc:2267] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.312829 22715 leader_election.cc:304] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.313081 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0f97254c55a47b5a5e96796ec18b049" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.313177 22782 raft_consensus.cc:3054] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.313287 23039 ts_tablet_manager.cc:1905] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.314009 22782 raft_consensus.cc:2463] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.314162 23082 raft_consensus.cc:2798] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.314249 23082 raft_consensus.cc:695] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.314355 23082 consensus_queue.cc:237] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.315156 23039 ts_tablet_manager.cc:1918] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.315217 23039 log.cc:1198] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/8fe1bc020af84f039e1560c7ae4f9176
I20250112 21:02:31.315209 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.315352 22465 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15] alter complete (version 2)
I20250112 21:02:31.315450 23039 ts_tablet_manager.cc:1939] T 8fe1bc020af84f039e1560c7ae4f9176 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.315670 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet f0f97254c55a47b5a5e96796ec18b049
I20250112 21:02:31.315891 23354 tablet.cc:1721] T 282486f313de4e99ae57aff652e29b66 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.316032 22459 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 1f164e6da7724fa8996766a41a0c214a
I20250112 21:02:31.316391 22463 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 11f19de7823b40c1ba7ed03d2d8adfcd
I20250112 21:02:31.316594 22463 catalog_manager.cc:6596] ReplaceTablet: tablet 11f19de7823b40c1ba7ed03d2d8adfcd deleted and replaced by tablet 56914e0635284561adb64897a0dfe37c
I20250112 21:02:31.287175 23037 tablet_bootstrap.cc:654] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.316761 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet d53dd4efde384b5d911f82e8d88326b8
I20250112 21:02:31.316956 22460 catalog_manager.cc:6596] ReplaceTablet: tablet d53dd4efde384b5d911f82e8d88326b8 deleted and replaced by tablet e5515bf0f1f5419d9af6b3d82fa33e7e
I20250112 21:02:31.317883 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 3f84f8f5e44e4d30bacf77072a86765d
W20250112 21:02:31.321295 22715 leader_election.cc:343] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.321658 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet f0f97254c55a47b5a5e96796ec18b049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.321827 23351 mvcc.cc:204] Tried to move back new op lower bound from 7113587717256810496 to 7113587716823408640. Current Snapshot: MvccSnapshot[applied={T|T < 7113587717256810496}]
I20250112 21:02:31.321812 22889 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd with delete_type TABLET_DATA_DELETED (replaced by tablet 56914e0635284561adb64897a0dfe37c) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.321964 22890 tablet_service.cc:1514] Processing DeleteTablet for tablet d53dd4efde384b5d911f82e8d88326b8 with delete_type TABLET_DATA_DELETED (replaced by tablet e5515bf0f1f5419d9af6b3d82fa33e7e) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.321815 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f164e6da7724fa8996766a41a0c214a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.322000 22580 leader_election.cc:304] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.321843 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.322304 23118 raft_consensus.cc:2798] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.322378 23118 raft_consensus.cc:695] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.322489 23118 consensus_queue.cc:237] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.323496 22466 catalog_manager.cc:5526] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } }
W20250112 21:02:31.323819 22851 consensus_peers.cc:487] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d -> Peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Couldn't send request to peer 0b63e675bcb141f3a7887ea5ef9ed2df. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a252d2647f84d9aaac1fc26f0de81b0. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.323961 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:31.324178 22717 leader_election.cc:343] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.325531 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 8fe1bc020af84f039e1560c7ae4f9176 (table default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]) successfully deleted
I20250112 21:02:31.271673 23038 ts_tablet_manager.cc:1939] T 79d16ad34f414aa6bfba934463afef73 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.326843 23038 tablet_replica.cc:331] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.326956 23038 raft_consensus.cc:2238] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.327386 23038 raft_consensus.cc:2267] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.327812 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet f0f97254c55a47b5a5e96796ec18b049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.327931 23038 ts_tablet_manager.cc:1905] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.327945 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328032 22755 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328065 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet d53dd4efde384b5d911f82e8d88326b8 with delete_type TABLET_DATA_DELETED (replaced by tablet e5515bf0f1f5419d9af6b3d82fa33e7e) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328095 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f164e6da7724fa8996766a41a0c214a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328150 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328184 23039 tablet_replica.cc:331] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.328040 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd with delete_type TABLET_DATA_DELETED (replaced by tablet 56914e0635284561adb64897a0dfe37c) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328295 23039 raft_consensus.cc:2238] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.328384 23039 raft_consensus.cc:2267] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.328485 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 79d16ad34f414aa6bfba934463afef73 (table default.Table_f190315f79014ff7b36f19c8a586e1f9 [id=4bec42d7adbd495eb28303688090171f]) successfully deleted
I20250112 21:02:31.328616 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.328758 23149 tablet.cc:1721] T 282486f313de4e99ae57aff652e29b66 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250112 21:02:31.328853 22717 leader_election.cc:343] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.328927 22717 leader_election.cc:304] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.328948 23039 ts_tablet_manager.cc:1905] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.329114 23065 raft_consensus.cc:2743] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.330834 23039 ts_tablet_manager.cc:1918] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.330911 23039 log.cc:1198] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/f0f97254c55a47b5a5e96796ec18b049
I20250112 21:02:31.331101 23039 ts_tablet_manager.cc:1939] T f0f97254c55a47b5a5e96796ec18b049 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.331612 22621 tablet_service.cc:1514] Processing DeleteTablet for tablet f0f97254c55a47b5a5e96796ec18b049 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.331791 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f84f8f5e44e4d30bacf77072a86765d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.331862 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f164e6da7724fa8996766a41a0c214a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.331964 22624 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f19de7823b40c1ba7ed03d2d8adfcd with delete_type TABLET_DATA_DELETED (replaced by tablet 56914e0635284561adb64897a0dfe37c) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.332074 22625 tablet_service.cc:1514] Processing DeleteTablet for tablet d53dd4efde384b5d911f82e8d88326b8 with delete_type TABLET_DATA_DELETED (replaced by tablet e5515bf0f1f5419d9af6b3d82fa33e7e) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.332370 23039 tablet_replica.cc:331] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.332504 23039 raft_consensus.cc:2238] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.332587 23039 raft_consensus.cc:2267] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.333433 23038 ts_tablet_manager.cc:1918] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.333503 23038 log.cc:1198] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/cfdd98834d4048e08c912c17bcb82674
I20250112 21:02:31.333658 23134 raft_consensus.cc:491] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.333717 23038 ts_tablet_manager.cc:1939] T cfdd98834d4048e08c912c17bcb82674 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.333737 23134 raft_consensus.cc:513] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.334074 23134 leader_election.cc:290] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.334266 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]) successfully deleted
I20250112 21:02:31.300355 23040 ts_tablet_manager.cc:1918] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.334460 23040 log.cc:1198] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/cfdd98834d4048e08c912c17bcb82674
I20250112 21:02:31.334693 23040 ts_tablet_manager.cc:1939] T cfdd98834d4048e08c912c17bcb82674 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.334996 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet f0f97254c55a47b5a5e96796ec18b049 (table default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]) successfully deleted
I20250112 21:02:31.335242 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet cfdd98834d4048e08c912c17bcb82674 (table default.Table_805fe24f44d64d60ad6655a1ae8a0027 [id=db81d19c0a6348a2baea3faee4f65f61]) successfully deleted
I20250112 21:02:31.335669 23036 tablet_bootstrap.cc:492] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.335744 23036 ts_tablet_manager.cc:1397] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20250112 21:02:31.336172 23036 raft_consensus.cc:357] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.336287 23036 raft_consensus.cc:383] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.336318 23036 raft_consensus.cc:738] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.336320 23038 tablet_replica.cc:331] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.336460 23036 consensus_queue.cc:260] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.336555 23038 raft_consensus.cc:2238] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.336696 23038 pending_rounds.cc:62] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Trying to abort 1 pending ops.
I20250112 21:02:31.336722 23036 ts_tablet_manager.cc:1428] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.336768 23040 tablet_replica.cc:331] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.336784 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce0379839924289921a2f75c986953a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.336902 23036 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.336887 23040 raft_consensus.cc:2238] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.336887 22782 raft_consensus.cc:2463] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.336977 23040 pending_rounds.cc:62] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:31.337002 23040 pending_rounds.cc:69] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715554021376 op_type: NO_OP noop_request { }
I20250112 21:02:31.337054 23040 raft_consensus.cc:2883] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.337102 23040 raft_consensus.cc:2267] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.337329 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce0379839924289921a2f75c986953a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.337384 22851 leader_election.cc:304] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:31.336725 23038 pending_rounds.cc:69] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587715554021376 op_type: NO_OP noop_request { }
I20250112 21:02:31.337575 23038 raft_consensus.cc:2883] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.337639 23038 raft_consensus.cc:2267] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.337649 23134 raft_consensus.cc:2798] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.337702 23134 raft_consensus.cc:491] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.337886 23134 raft_consensus.cc:3054] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.338132 23036 tablet_bootstrap.cc:654] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.338773 23134 raft_consensus.cc:513] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.339425 23037 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.339510 23037 ts_tablet_manager.cc:1397] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.000s
W20250112 21:02:31.339828 22851 leader_election.cc:343] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.339941 23037 raft_consensus.cc:357] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.340032 23037 raft_consensus.cc:383] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.340061 23037 raft_consensus.cc:738] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.340167 23037 consensus_queue.cc:260] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.340263 23134 leader_election.cc:290] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.340503 23037 ts_tablet_manager.cc:1428] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.340626 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce0379839924289921a2f75c986953a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.340668 23037 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.340723 22782 raft_consensus.cc:3054] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.341205 22914 raft_consensus.cc:2463] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.341584 23037 tablet_bootstrap.cc:654] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.341593 22782 raft_consensus.cc:2463] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:31.342041 23039 ts_tablet_manager.cc:1905] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.342789 22851 leader_election.cc:304] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:31.343951 23134 raft_consensus.cc:2798] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.344125 23039 ts_tablet_manager.cc:1918] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.344187 23039 log.cc:1198] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/3f84f8f5e44e4d30bacf77072a86765d
I20250112 21:02:31.344363 23039 ts_tablet_manager.cc:1939] T 3f84f8f5e44e4d30bacf77072a86765d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.344370 23134 raft_consensus.cc:695] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:31.344595 23134 consensus_queue.cc:237] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.344928 23039 tablet_replica.cc:331] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.344936 23036 tablet_bootstrap.cc:492] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.345012 23036 ts_tablet_manager.cc:1397] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250112 21:02:31.345055 23039 raft_consensus.cc:2238] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.345188 23039 pending_rounds.cc:62] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:31.345199 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 3f84f8f5e44e4d30bacf77072a86765d (table default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]) successfully deleted
I20250112 21:02:31.345219 23039 pending_rounds.cc:69] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587717339832320 op_type: NO_OP noop_request { }
I20250112 21:02:31.345268 23039 raft_consensus.cc:2883] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.345309 23039 raft_consensus.cc:2267] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.345587 23036 raft_consensus.cc:357] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.345696 23036 raft_consensus.cc:383] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.345733 23036 raft_consensus.cc:738] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.345850 23036 consensus_queue.cc:260] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.346146 23036 ts_tablet_manager.cc:1428] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.346328 23036 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.347198 23036 tablet_bootstrap.cc:654] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.349213 23038 ts_tablet_manager.cc:1905] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.349786 23065 raft_consensus.cc:491] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.349859 23065 raft_consensus.cc:513] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.350160 23065 leader_election.cc:290] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.350432 23036 tablet_bootstrap.cc:492] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.350503 23036 ts_tablet_manager.cc:1397] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:31.350518 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeeebb5039b4ca38450a0f727d1e0fd" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.350628 22646 raft_consensus.cc:2463] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.350899 22715 leader_election.cc:304] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.350900 23036 raft_consensus.cc:357] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.350988 23036 raft_consensus.cc:383] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.351018 23036 raft_consensus.cc:738] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.351049 23065 raft_consensus.cc:2798] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.351089 23065 raft_consensus.cc:491] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.351119 23065 raft_consensus.cc:3054] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.351119 23036 consensus_queue.cc:260] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.351390 23036 ts_tablet_manager.cc:1428] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.351550 23036 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.351927 23065 raft_consensus.cc:513] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.352226 23065 leader_election.cc:290] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.352495 23036 tablet_bootstrap.cc:654] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.352591 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeeebb5039b4ca38450a0f727d1e0fd" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.352689 22646 raft_consensus.cc:3054] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.353257 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 282486f313de4e99ae57aff652e29b66 (table default.Table_3ec39e98832645acb9cc15e604392112 [id=372bcd1b7412419bb6a2a7a6bc87dd4a]). Expected version 1 got 0
I20250112 21:02:31.353523 22646 raft_consensus.cc:2463] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.353783 22715 leader_election.cc:304] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.354758 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 282486f313de4e99ae57aff652e29b66 (table default.Table_3ec39e98832645acb9cc15e604392112 [id=372bcd1b7412419bb6a2a7a6bc87dd4a]). Expected version 1 got 0
I20250112 21:02:31.354904 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 0ce0379839924289921a2f75c986953a (table default.Table_c46e41e9bbd5419496479d9a2b69e46c [id=490ed39e4b39477896146f5b117fb296]). Expected version 1 got 0
I20250112 21:02:31.354998 22461 catalog_manager.cc:5526] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.355199 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]). Expected version 1 got 0
I20250112 21:02:31.356371 23065 raft_consensus.cc:2798] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.356483 23065 raft_consensus.cc:695] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.356592 23065 consensus_queue.cc:237] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.358743 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ce0379839924289921a2f75c986953a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.360320 22466 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_3ec39e98832645acb9cc15e604392112 [id=372bcd1b7412419bb6a2a7a6bc87dd4a] alter complete (version 1)
W20250112 21:02:31.361354 22851 leader_election.cc:343] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.361711 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeeebb5039b4ca38450a0f727d1e0fd" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.361811 22914 raft_consensus.cc:2463] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.362114 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abeeebb5039b4ca38450a0f727d1e0fd" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.362208 22914 raft_consensus.cc:3054] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.363091 22914 raft_consensus.cc:2463] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.365175 23038 ts_tablet_manager.cc:1918] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.365293 23038 log.cc:1198] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/5a252d2647f84d9aaac1fc26f0de81b0
I20250112 21:02:31.365567 23038 ts_tablet_manager.cc:1939] T 5a252d2647f84d9aaac1fc26f0de81b0 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.366269 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 5a252d2647f84d9aaac1fc26f0de81b0 (table default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]) successfully deleted
I20250112 21:02:31.366513 23038 tablet_replica.cc:331] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.366686 23038 raft_consensus.cc:2238] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.366910 23038 raft_consensus.cc:2267] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.367317 23038 ts_tablet_manager.cc:1905] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.367736 23039 ts_tablet_manager.cc:1905] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.368283 22464 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_61803d2edd2e4cb0965b9b9cc1c8f9e4 [id=3b6e9944498d4cabb74a389a3a9bd5b8] alter complete (version 1)
I20250112 21:02:31.369755 23039 ts_tablet_manager.cc:1918] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.369819 23039 log.cc:1198] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/d53dd4efde384b5d911f82e8d88326b8
I20250112 21:02:31.370036 23039 ts_tablet_manager.cc:1939] T d53dd4efde384b5d911f82e8d88326b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
W20250112 21:02:31.370050 23386 consensus_queue.cc:1159] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d8faec3969b64c33a4bf9aba509785ea" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250112 21:02:31.370581 23039 tablet_replica.cc:331] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.370745 23039 raft_consensus.cc:2238] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.370880 23039 pending_rounds.cc:62] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:31.370910 23039 pending_rounds.cc:69] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587717384704000 op_type: NO_OP noop_request { }
I20250112 21:02:31.370958 23039 raft_consensus.cc:2883] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.371004 23039 raft_consensus.cc:2267] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.371639 23039 ts_tablet_manager.cc:1905] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.373370 23039 ts_tablet_manager.cc:1918] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.373431 23039 log.cc:1198] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/1f164e6da7724fa8996766a41a0c214a
I20250112 21:02:31.373646 23039 ts_tablet_manager.cc:1939] T 1f164e6da7724fa8996766a41a0c214a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.374145 23039 tablet_replica.cc:331] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.374125 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet d53dd4efde384b5d911f82e8d88326b8 (table default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]) successfully deleted
I20250112 21:02:31.374266 23039 raft_consensus.cc:2238] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.374392 23039 pending_rounds.cc:62] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Trying to abort 1 pending ops.
I20250112 21:02:31.374415 23039 pending_rounds.cc:69] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587717557555200 op_type: NO_OP noop_request { }
I20250112 21:02:31.374419 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:31.374459 23039 raft_consensus.cc:2883] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.374501 23039 raft_consensus.cc:2267] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.372051 23084 tablet.cc:1721] T 282486f313de4e99ae57aff652e29b66 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.374670 23134 raft_consensus.cc:491] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.375039 23134 raft_consensus.cc:513] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.375348 23134 leader_election.cc:290] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.375779 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.375906 22782 raft_consensus.cc:2388] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3423673c659e4427958b13fc9eaa714d in current term 1: Already voted for candidate d8faec3969b64c33a4bf9aba509785ea in this term.
I20250112 21:02:31.378077 23038 ts_tablet_manager.cc:1918] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.378206 23038 log.cc:1198] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/8fe1bc020af84f039e1560c7ae4f9176
I20250112 21:02:31.378430 23038 ts_tablet_manager.cc:1939] T 8fe1bc020af84f039e1560c7ae4f9176 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
W20250112 21:02:31.378847 23392 consensus_queue.cc:1159] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250112 21:02:31.379550 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 8fe1bc020af84f039e1560c7ae4f9176 (table default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]) successfully deleted
I20250112 21:02:31.380651 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c65081e9a22142babc740190cb3a96b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.381038 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c65081e9a22142babc740190cb3a96b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.381203 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_96d34d168eab498ea95aac82aa02ba0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.381556 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96d34d168eab498ea95aac82aa02ba0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.382491 22463 catalog_manager.cc:5526] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.382671 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 0ce0379839924289921a2f75c986953a (table default.Table_c46e41e9bbd5419496479d9a2b69e46c [id=490ed39e4b39477896146f5b117fb296]). Expected version 1 got 0
I20250112 21:02:31.382771 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 282486f313de4e99ae57aff652e29b66 (table default.Table_3ec39e98832645acb9cc15e604392112 [id=372bcd1b7412419bb6a2a7a6bc87dd4a]). Expected version 1 got 0
I20250112 21:02:31.385388 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_16f13034cb3a4c2baa025926c4add500"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.385681 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f13034cb3a4c2baa025926c4add500 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.387975 23038 tablet_replica.cc:331] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.388078 23039 ts_tablet_manager.cc:1905] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.389560 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c22a901e6c4348a9b0e79598a93cae" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.389757 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.390228 23039 ts_tablet_manager.cc:1918] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.390311 23039 log.cc:1198] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/abeeebb5039b4ca38450a0f727d1e0fd
I20250112 21:02:31.390295 22851 leader_election.cc:304] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.390529 23039 ts_tablet_manager.cc:1939] T abeeebb5039b4ca38450a0f727d1e0fd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.390527 23134 raft_consensus.cc:3054] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.390928 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.391067 23039 tablet_replica.cc:331] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.391184 23039 raft_consensus.cc:2238] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.391302 23039 raft_consensus.cc:2267] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.391388 23134 raft_consensus.cc:2743] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.390933 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.391877 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.391897 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet abeeebb5039b4ca38450a0f727d1e0fd (table default.Table_19b0a72a5b4547e2925b2761711c4951 [id=a34fe8525b16448eb589cd0b380d1ee0]) successfully deleted
I20250112 21:02:31.392082 23038 raft_consensus.cc:2238] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.392212 23038 raft_consensus.cc:2267] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.392609 23039 ts_tablet_manager.cc:1905] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.393999 23038 ts_tablet_manager.cc:1905] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.394333 23039 ts_tablet_manager.cc:1918] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250112 21:02:31.394400 23039 log.cc:1198] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/11f19de7823b40c1ba7ed03d2d8adfcd
I20250112 21:02:31.394613 23039 ts_tablet_manager.cc:1939] T 11f19de7823b40c1ba7ed03d2d8adfcd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.395114 23039 tablet_replica.cc:331] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.395217 23039 raft_consensus.cc:2238] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.395255 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:31.395304 23039 raft_consensus.cc:2267] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.395766 23039 ts_tablet_manager.cc:1905] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.395893 23036 tablet_bootstrap.cc:492] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.395968 23036 ts_tablet_manager.cc:1397] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20250112 21:02:31.396747 23036 raft_consensus.cc:357] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.396852 23036 raft_consensus.cc:383] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.396883 23036 raft_consensus.cc:738] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.396986 23036 consensus_queue.cc:260] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.397256 23036 ts_tablet_manager.cc:1428] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.397440 23036 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.397486 23039 ts_tablet_manager.cc:1918] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.397538 23039 log.cc:1198] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.397707 23039 ts_tablet_manager.cc:1939] T 04616ed61b134e889503c3b336ad4054 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.398253 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 04616ed61b134e889503c3b336ad4054 (table default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]) successfully deleted
I20250112 21:02:31.398372 23036 tablet_bootstrap.cc:654] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.399119 23039 tablet_replica.cc:331] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.399233 23039 raft_consensus.cc:2238] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.399318 23039 raft_consensus.cc:2267] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.399484 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.399966 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet abeeebb5039b4ca38450a0f727d1e0fd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:30 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.400377 23039 ts_tablet_manager.cc:1905] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.401140 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_57c9487892f843288e0eda879e5f3164"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.401487 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57c9487892f843288e0eda879e5f3164 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.404206 23038 ts_tablet_manager.cc:1918] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.404317 23038 log.cc:1198] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/f0f97254c55a47b5a5e96796ec18b049
I20250112 21:02:31.404501 22782 raft_consensus.cc:1270] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.404614 23038 ts_tablet_manager.cc:1939] T f0f97254c55a47b5a5e96796ec18b049 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.404978 23049 consensus_queue.cc:1035] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.405128 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet f0f97254c55a47b5a5e96796ec18b049 (table default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]) successfully deleted
I20250112 21:02:31.405669 22626 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2e8bde44bc453fa202d8c81356ad3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.406119 23036 tablet_bootstrap.cc:492] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.406201 23036 ts_tablet_manager.cc:1397] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250112 21:02:31.406615 23036 raft_consensus.cc:357] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.406705 23036 raft_consensus.cc:383] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.406731 23036 raft_consensus.cc:738] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.406842 23036 consensus_queue.cc:260] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.407068 23036 ts_tablet_manager.cc:1428] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.407251 23036 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.408116 23036 tablet_bootstrap.cc:654] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.408895 22917 raft_consensus.cc:1270] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer d8faec3969b64c33a4bf9aba509785ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.409031 23039 ts_tablet_manager.cc:1918] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.409091 23039 log.cc:1198] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.409289 23039 ts_tablet_manager.cc:1939] T 1e2e8bde44bc453fa202d8c81356ad3b P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.410132 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 1e2e8bde44bc453fa202d8c81356ad3b (table default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]) successfully deleted
W20250112 21:02:31.410290 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet abeeebb5039b4ca38450a0f727d1e0fd because the tablet was not found. No further retry: Not found: Tablet not found: abeeebb5039b4ca38450a0f727d1e0fd
I20250112 21:02:31.410758 23049 consensus_queue.cc:1035] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.411665 23038 tablet_replica.cc:331] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.411829 23038 raft_consensus.cc:2238] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.411955 23038 raft_consensus.cc:2267] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.412492 23038 ts_tablet_manager.cc:1905] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.415674 23038 ts_tablet_manager.cc:1918] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250112 21:02:31.415791 23038 log.cc:1198] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/11f19de7823b40c1ba7ed03d2d8adfcd
I20250112 21:02:31.416044 23038 ts_tablet_manager.cc:1939] T 11f19de7823b40c1ba7ed03d2d8adfcd P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.416710 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:31.417109 22464 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:31.418159 22781 raft_consensus.cc:1270] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.418589 23134 consensus_queue.cc:1035] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.419636 23135 raft_consensus.cc:491] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.419699 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
I20250112 21:02:31.419719 23135 raft_consensus.cc:513] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.420020 23135 leader_election.cc:290] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:31.420850 22851 leader_election.cc:343] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 3f84f8f5e44e4d30bacf77072a86765d
I20250112 21:02:31.424899 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f84f8f5e44e4d30bacf77072a86765d" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:31.426115 22851 consensus_peers.cc:487] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d -> Peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Couldn't send request to peer d8faec3969b64c33a4bf9aba509785ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.426263 22851 leader_election.cc:304] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.426465 23135 raft_consensus.cc:2743] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.428473 22466 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 0ce0379839924289921a2f75c986953a (table default.Table_c46e41e9bbd5419496479d9a2b69e46c [id=490ed39e4b39477896146f5b117fb296]). Expected version 1 got 0
I20250112 21:02:31.429481 23084 tablet.cc:1721] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.429852 23038 tablet_replica.cc:331] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.429970 23038 raft_consensus.cc:2238] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.430015 23146 mvcc.cc:204] Tried to move back new op lower bound from 7113587717805080576 to 7113587717511135232. Current Snapshot: MvccSnapshot[applied={T|T < 7113587717805080576}]
I20250112 21:02:31.430069 23038 raft_consensus.cc:2267] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.430521 23149 tablet.cc:1721] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250112 21:02:31.431609 22580 consensus_peers.cc:487] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea -> Peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Couldn't send request to peer 0b63e675bcb141f3a7887ea5ef9ed2df. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f84f8f5e44e4d30bacf77072a86765d. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.433653 23038 ts_tablet_manager.cc:1905] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.437615 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_815884d779484b9fb60f34ddfdaa5247"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.437991 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_815884d779484b9fb60f34ddfdaa5247 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.438819 23036 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.438899 23036 ts_tablet_manager.cc:1397] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20250112 21:02:31.439375 23036 raft_consensus.cc:357] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.439463 23036 raft_consensus.cc:383] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.439491 23036 raft_consensus.cc:738] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.439591 23036 consensus_queue.cc:260] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.439828 23036 ts_tablet_manager.cc:1428] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.442420 23038 ts_tablet_manager.cc:1918] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.442535 23038 log.cc:1198] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/d53dd4efde384b5d911f82e8d88326b8
I20250112 21:02:31.442773 23038 ts_tablet_manager.cc:1939] T d53dd4efde384b5d911f82e8d88326b8 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.444073 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_0e82eb25c2fc428c8e093ecb164f72f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.444267 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_54d6785b593b4b0e8c1733184e418031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.444518 22458 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0126ff3f63db452aa29542957b7ddcbf" } new_table_name: "default.Table_5487430f075043b691e493891c986d07" modify_external_catalogs: true
W20250112 21:02:31.445333 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e82eb25c2fc428c8e093ecb164f72f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.445473 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_624f4605a9ab4e2ea3f152df04bcd56b" } new_table_name: "default.Table_d73f9b21518a49e798e5dff732a78293" modify_external_catalogs: true
W20250112 21:02:31.446460 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54d6785b593b4b0e8c1733184e418031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.449036 22463 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_c46e41e9bbd5419496479d9a2b69e46c [id=490ed39e4b39477896146f5b117fb296] alter complete (version 1)
I20250112 21:02:31.450500 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet d53dd4efde384b5d911f82e8d88326b8 (table default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]) successfully deleted
I20250112 21:02:31.450676 23038 tablet_replica.cc:331] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.450783 23038 raft_consensus.cc:2238] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.450863 23038 raft_consensus.cc:2267] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.451236 23038 ts_tablet_manager.cc:1905] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:31.452812 22458 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0aad32a4d5f40c69b28219f0cc42538 has no consensus state
I20250112 21:02:31.457515 23134 raft_consensus.cc:491] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.457602 23134 raft_consensus.cc:513] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.457726 23040 ts_tablet_manager.cc:1905] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.457791 23135 consensus_queue.cc:1035] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.457928 23134 leader_election.cc:290] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.458350 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04616ed61b134e889503c3b336ad4054" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.458469 22647 raft_consensus.cc:2463] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
W20250112 21:02:31.459120 22851 leader_election.cc:343] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.461277 23040 ts_tablet_manager.cc:1918] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.461349 23040 log.cc:1198] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/5a252d2647f84d9aaac1fc26f0de81b0
I20250112 21:02:31.461587 23040 ts_tablet_manager.cc:1939] T 5a252d2647f84d9aaac1fc26f0de81b0 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.461894 22851 leader_election.cc:304] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df
I20250112 21:02:31.462113 23134 raft_consensus.cc:2798] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.462162 23134 raft_consensus.cc:491] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.462210 23134 raft_consensus.cc:3054] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.462246 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 5a252d2647f84d9aaac1fc26f0de81b0 (table default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]) successfully deleted
I20250112 21:02:31.462471 23040 tablet_replica.cc:331] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.462605 23040 raft_consensus.cc:2238] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.462698 23040 raft_consensus.cc:2267] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.463008 23040 ts_tablet_manager.cc:1905] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.463060 23134 raft_consensus.cc:513] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.463385 23134 leader_election.cc:290] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.463851 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04616ed61b134e889503c3b336ad4054" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.463958 22647 raft_consensus.cc:3054] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.464005 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8144da4b814841939a715b4ffe42117a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.464354 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8144da4b814841939a715b4ffe42117a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.464797 22647 raft_consensus.cc:2463] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
W20250112 21:02:31.465158 22851 leader_election.cc:343] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.465302 22851 leader_election.cc:304] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df
I20250112 21:02:31.465579 23134 raft_consensus.cc:2798] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.465658 23134 raft_consensus.cc:695] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:31.465780 23134 consensus_queue.cc:237] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.467978 22914 raft_consensus.cc:3054] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.469839 23049 consensus_queue.cc:1035] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.471580 23149 tablet.cc:1721] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.473323 23354 tablet.cc:1721] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.474821 23084 tablet.cc:1721] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.475766 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bf0165659b1547e2843f8ac01f667c83" } new_table_name: "default.Table_151bce48dcde41a0841fdbd516d209fc" modify_external_catalogs: true
I20250112 21:02:31.476835 22463 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_57c9487892f843288e0eda879e5f3164" } modify_external_catalogs: true
I20250112 21:02:31.476938 22463 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_57c9487892f843288e0eda879e5f3164" } modify_external_catalogs: true
I20250112 21:02:31.477943 22459 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c46e41e9bbd5419496479d9a2b69e46c" } new_table_name: "default.Table_334064033b144ee1af033570e8132ce6" modify_external_catalogs: true
I20250112 21:02:31.478808 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_97936dd45d9b496cbbd47d899dfa6433"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.479346 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97936dd45d9b496cbbd47d899dfa6433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.475777 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_5487430f075043b691e493891c986d07" } modify_external_catalogs: true
I20250112 21:02:31.482359 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_5487430f075043b691e493891c986d07" } modify_external_catalogs: true
I20250112 21:02:31.486100 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f4a783bd63d14dfbbe32dbb16f30aa9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.486560 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4a783bd63d14dfbbe32dbb16f30aa9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.492671 23038 ts_tablet_manager.cc:1918] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.492805 23038 log.cc:1198] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/1f164e6da7724fa8996766a41a0c214a
I20250112 21:02:31.493074 23038 ts_tablet_manager.cc:1939] T 1f164e6da7724fa8996766a41a0c214a P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.493773 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:31.494045 23038 tablet_replica.cc:331] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.494221 23038 raft_consensus.cc:2238] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.494230 23040 ts_tablet_manager.cc:1918] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.494307 23040 log.cc:1198] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/8fe1bc020af84f039e1560c7ae4f9176
I20250112 21:02:31.494522 23040 ts_tablet_manager.cc:1939] T 8fe1bc020af84f039e1560c7ae4f9176 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.494607 23038 raft_consensus.cc:2267] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.495780 23037 tablet_bootstrap.cc:492] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.495882 23037 ts_tablet_manager.cc:1397] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.155s user 0.001s sys 0.000s
I20250112 21:02:31.496013 23038 ts_tablet_manager.cc:1905] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.496340 23037 raft_consensus.cc:357] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.496493 23037 raft_consensus.cc:383] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.496543 23037 raft_consensus.cc:738] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.496670 23037 consensus_queue.cc:260] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.496945 23037 ts_tablet_manager.cc:1428] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.497139 23037 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.498087 23037 tablet_bootstrap.cc:654] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.499105 23038 ts_tablet_manager.cc:1918] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.499248 23038 log.cc:1198] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/3f84f8f5e44e4d30bacf77072a86765d
I20250112 21:02:31.499564 23038 ts_tablet_manager.cc:1939] T 3f84f8f5e44e4d30bacf77072a86765d P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.500101 22460 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c" } new_table_name: "default.Table_43fd2301070a49119af5f07230e04cd0" modify_external_catalogs: true
I20250112 21:02:31.500583 23038 tablet_replica.cc:331] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.500751 23038 raft_consensus.cc:2238] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.501283 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 3f84f8f5e44e4d30bacf77072a86765d (table default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]) successfully deleted
I20250112 21:02:31.505681 22457 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_d73f9b21518a49e798e5dff732a78293 [id=75df653ef27a498a96a8725368b32a4b] alter complete (version 1)
I20250112 21:02:31.506234 22781 raft_consensus.cc:1270] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.506618 23046 consensus_queue.cc:1035] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.509295 23037 tablet_bootstrap.cc:492] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.509411 23037 ts_tablet_manager.cc:1397] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250112 21:02:31.509864 23037 raft_consensus.cc:357] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.509989 23037 raft_consensus.cc:383] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.510030 23037 raft_consensus.cc:738] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.510190 23037 consensus_queue.cc:260] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.510409 22462 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 0ce0379839924289921a2f75c986953a (table default.Table_334064033b144ee1af033570e8132ce6 [id=490ed39e4b39477896146f5b117fb296]). Expected version 2 got 0
I20250112 21:02:31.510555 23037 ts_tablet_manager.cc:1428] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.510694 23037 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.512218 23084 tablet.cc:1721] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.513151 22757 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 (DEFAULT_TABLE table=default.Table_57c9487892f843288e0eda879e5f3164 [id=8a74c5a816684dd995d043af0acf9891]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.513409 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdbdb92c2f5441796e20643a5e02a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.513557 22758 tablet_service.cc:1467] Processing CreateTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d (DEFAULT_TABLE table=default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.513773 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29dbc7d2a6f4ab2b645958e69665d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.513806 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 1ded0955d63e42d78453ee94a59d413d (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.513988 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded0955d63e42d78453ee94a59d413d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.515460 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 3f292d9ff408488a84d432050ab317fc (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.515650 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f292d9ff408488a84d432050ab317fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.515760 22756 tablet_service.cc:1467] Processing CreateTablet for tablet b6d8f7cf39be44cc8bbae6e68e97beb2 (DEFAULT_TABLE table=default.Table_6dca3743bd384f20844603fc314e151f [id=49b0143652e8448c90bffd51818c4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.515983 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d8f7cf39be44cc8bbae6e68e97beb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.516269 23037 tablet_bootstrap.cc:654] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.517369 23034 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.513398 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (DEFAULT_TABLE table=default.Table_b44cd661c42a45b480baa1ea160d909f [id=95803b5342bb4561be8bc0478cc8ca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.518180 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e55df14b84ca9af9fb2ee73022bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.518229 23034 tablet_bootstrap.cc:654] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.513398 22755 tablet_service.cc:1467] Processing CreateTablet for tablet 92cbead1e7a04ee58645c8a03fbfd71e (DEFAULT_TABLE table=default.Table_96d34d168eab498ea95aac82aa02ba0d [id=ec21b6bc33d74ccdac2ae1e2b69956e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.518921 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbead1e7a04ee58645c8a03fbfd71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.523813 23038 raft_consensus.cc:2267] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.524487 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 1ded0955d63e42d78453ee94a59d413d (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.524731 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded0955d63e42d78453ee94a59d413d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.525859 22893 tablet_service.cc:1467] Processing CreateTablet for tablet 3f292d9ff408488a84d432050ab317fc (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.526010 23038 ts_tablet_manager.cc:1905] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.526078 22893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f292d9ff408488a84d432050ab317fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.527947 23036 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.528187 22893 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5332ec945740f0a998b1fb9848387a (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.532490 23081 tablet.cc:1721] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.533638 22759 tablet_service.cc:1467] Processing CreateTablet for tablet 43b4420df3e84c1888043baa9f2dd692 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.533865 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4420df3e84c1888043baa9f2dd692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.534065 23081 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.534354 23354 tablet.cc:1721] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.534454 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 458bbc607af0400d93fe7990999d90b9 (DEFAULT_TABLE table=default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.534660 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458bbc607af0400d93fe7990999d90b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.534783 22755 tablet_service.cc:1467] Processing CreateTablet for tablet b40002b2a71741d9833974adc89e0c4e (DEFAULT_TABLE table=default.Table_d90a9cd4efd54c5fae3e012693cea10a [id=54cb1bc41617475294f6b87b15864901]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.534960 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40002b2a71741d9833974adc89e0c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.535765 22754 tablet_service.cc:1467] Processing CreateTablet for tablet 65b0da9ee2d545e8acef16ad06ac1966 (DEFAULT_TABLE table=default.Table_e1696bafd2c7402ca2222344c4db901d [id=16cfbc372c994f5fb305c70cdadd0abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.535995 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0da9ee2d545e8acef16ad06ac1966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.537766 23040 tablet_replica.cc:331] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.537897 23040 raft_consensus.cc:2238] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.538036 23040 pending_rounds.cc:62] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:31.538064 23040 pending_rounds.cc:69] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587717418201088 op_type: NO_OP noop_request { }
I20250112 21:02:31.538117 23040 raft_consensus.cc:2883] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.538166 23040 raft_consensus.cc:2267] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.539160 22753 tablet_service.cc:1467] Processing CreateTablet for tablet e4598f42f64b4354af0cfb53826d59e3 (DEFAULT_TABLE table=default.Table_c65081e9a22142babc740190cb3a96b7 [id=3a53c2f5d23c457eb8621b1f017badf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.539371 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4598f42f64b4354af0cfb53826d59e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.539405 23040 ts_tablet_manager.cc:1905] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.540584 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 (DEFAULT_TABLE table=default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.540791 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbf428b373d462ca89bd39795c6ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.541446 23040 ts_tablet_manager.cc:1918] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.541512 23040 log.cc:1198] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/f0f97254c55a47b5a5e96796ec18b049
I20250112 21:02:31.541735 23040 ts_tablet_manager.cc:1939] T f0f97254c55a47b5a5e96796ec18b049 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.542276 23040 tablet_replica.cc:331] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.542299 23037 tablet_bootstrap.cc:492] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.542380 23037 ts_tablet_manager.cc:1397] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20250112 21:02:31.542397 23040 raft_consensus.cc:2238] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.542623 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.542670 23040 raft_consensus.cc:2267] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.542821 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db56f76b0b7473bb5d70463ec5b2484. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.542869 23037 raft_consensus.cc:357] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.542964 23037 raft_consensus.cc:383] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.542994 23037 raft_consensus.cc:738] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.543100 23037 consensus_queue.cc:260] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.543186 23040 ts_tablet_manager.cc:1905] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.543419 23037 ts_tablet_manager.cc:1428] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.544974 23040 ts_tablet_manager.cc:1918] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.545038 23040 log.cc:1198] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/3f84f8f5e44e4d30bacf77072a86765d
I20250112 21:02:31.545254 23040 ts_tablet_manager.cc:1939] T 3f84f8f5e44e4d30bacf77072a86765d P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.545897 23040 tablet_replica.cc:331] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.546011 23040 raft_consensus.cc:2238] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.546093 23040 raft_consensus.cc:2267] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.546391 23040 ts_tablet_manager.cc:1905] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.546638 23081 tablet.cc:1721] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.547147 23034 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.547221 23034 ts_tablet_manager.cc:1397] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.000s
I20250112 21:02:31.547719 23034 raft_consensus.cc:357] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.547803 23034 raft_consensus.cc:383] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.547829 23034 raft_consensus.cc:738] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.547930 23034 consensus_queue.cc:260] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.548004 23040 ts_tablet_manager.cc:1918] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.548061 23040 log.cc:1198] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/1f164e6da7724fa8996766a41a0c214a
I20250112 21:02:31.548151 23034 ts_tablet_manager.cc:1428] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.548310 23034 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.552539 22623 tablet_service.cc:1467] Processing CreateTablet for tablet 1ded0955d63e42d78453ee94a59d413d (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.552707 22622 tablet_service.cc:1467] Processing CreateTablet for tablet 3f292d9ff408488a84d432050ab317fc (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.552795 22623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ded0955d63e42d78453ee94a59d413d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.552919 22622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f292d9ff408488a84d432050ab317fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.553045 22620 tablet_service.cc:1467] Processing CreateTablet for tablet b40002b2a71741d9833974adc89e0c4e (DEFAULT_TABLE table=default.Table_d90a9cd4efd54c5fae3e012693cea10a [id=54cb1bc41617475294f6b87b15864901]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.553124 22626 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 (DEFAULT_TABLE table=default.Table_57c9487892f843288e0eda879e5f3164 [id=8a74c5a816684dd995d043af0acf9891]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.553231 22646 raft_consensus.cc:3054] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.553256 22620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40002b2a71741d9833974adc89e0c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.553447 22624 tablet_service.cc:1467] Processing CreateTablet for tablet 92cbead1e7a04ee58645c8a03fbfd71e (DEFAULT_TABLE table=default.Table_96d34d168eab498ea95aac82aa02ba0d [id=ec21b6bc33d74ccdac2ae1e2b69956e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.553628 22624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbead1e7a04ee58645c8a03fbfd71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.554114 22646 raft_consensus.cc:1270] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.554875 22619 tablet_service.cc:1467] Processing CreateTablet for tablet d19c73dce51147e29837df3b364af790 (DEFAULT_TABLE table=default.Table_44a18784001e45b3a8c92835db52640c [id=412aa24e1d20476ab4b6bfaf07c72e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.555084 22619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19c73dce51147e29837df3b364af790. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.555486 22625 tablet_service.cc:1467] Processing CreateTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d (DEFAULT_TABLE table=default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.555686 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29dbc7d2a6f4ab2b645958e69665d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.556624 22618 tablet_service.cc:1467] Processing CreateTablet for tablet c84208a885c54f6c8dfde6f91b1c938a (DEFAULT_TABLE table=default.Table_2ab7b7c9de6a4ef0af72a85800f3a067 [id=3a02f0bc71554fb4a90c388ed1ad3a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.556813 22618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84208a885c54f6c8dfde6f91b1c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.557566 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (DEFAULT_TABLE table=default.Table_b44cd661c42a45b480baa1ea160d909f [id=95803b5342bb4561be8bc0478cc8ca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.557766 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e55df14b84ca9af9fb2ee73022bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.558535 22617 tablet_service.cc:1467] Processing CreateTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 (DEFAULT_TABLE table=default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.558739 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbf428b373d462ca89bd39795c6ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.558708 22462 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (table default.Table_151bce48dcde41a0841fdbd516d209fc [id=ac0d0569964b4de4bed1988303be50d0]). Expected version 1 got 0
I20250112 21:02:31.559551 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 77617388a31447f196febf2980f3f410 (DEFAULT_TABLE table=default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.559749 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77617388a31447f196febf2980f3f410. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.560072 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 77617388a31447f196febf2980f3f410 (DEFAULT_TABLE table=default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.560310 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77617388a31447f196febf2980f3f410. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.560524 22616 tablet_service.cc:1467] Processing CreateTablet for tablet 458bbc607af0400d93fe7990999d90b9 (DEFAULT_TABLE table=default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.560732 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458bbc607af0400d93fe7990999d90b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.562304 22464 master_service.cc:946] ReplaceTablet: received request to replace tablet 2faf8cc5d3604e7ab814be894c842fc2 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.562601 23037 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.562736 22762 tablet_service.cc:1467] Processing CreateTablet for tablet d19c73dce51147e29837df3b364af790 (DEFAULT_TABLE table=default.Table_44a18784001e45b3a8c92835db52640c [id=412aa24e1d20476ab4b6bfaf07c72e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.562950 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19c73dce51147e29837df3b364af790. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.563047 22458 master_service.cc:946] ReplaceTablet: received request to replace tablet 159ed04aaf0447ad9b016d39f3271aaf from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.564603 22614 tablet_service.cc:1467] Processing CreateTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.564613 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_16f13034cb3a4c2baa025926c4add500" } modify_external_catalogs: true
I20250112 21:02:31.564633 22756 tablet_service.cc:1467] Processing CreateTablet for tablet c84208a885c54f6c8dfde6f91b1c938a (DEFAULT_TABLE table=default.Table_2ab7b7c9de6a4ef0af72a85800f3a067 [id=3a02f0bc71554fb4a90c388ed1ad3a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.564709 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_16f13034cb3a4c2baa025926c4add500" } modify_external_catalogs: true
I20250112 21:02:31.564808 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db56f76b0b7473bb5d70463ec5b2484. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.564826 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84208a885c54f6c8dfde6f91b1c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.565909 23037 tablet_bootstrap.cc:654] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.566233 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_54d6785b593b4b0e8c1733184e418031" } modify_external_catalogs: true
I20250112 21:02:31.566334 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_54d6785b593b4b0e8c1733184e418031" } modify_external_catalogs: true
I20250112 21:02:31.566507 23040 ts_tablet_manager.cc:1939] T 1f164e6da7724fa8996766a41a0c214a P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.566629 22613 tablet_service.cc:1467] Processing CreateTablet for tablet 43b4420df3e84c1888043baa9f2dd692 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.566833 22613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4420df3e84c1888043baa9f2dd692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.567008 22459 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d73f9b21518a49e798e5dff732a78293" } modify_external_catalogs: true
I20250112 21:02:31.567090 22459 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d73f9b21518a49e798e5dff732a78293" } modify_external_catalogs: true
I20250112 21:02:31.552516 22627 tablet_service.cc:1467] Processing CreateTablet for tablet b6d8f7cf39be44cc8bbae6e68e97beb2 (DEFAULT_TABLE table=default.Table_6dca3743bd384f20844603fc314e151f [id=49b0143652e8448c90bffd51818c4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.567873 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d8f7cf39be44cc8bbae6e68e97beb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.528378 22893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5332ec945740f0a998b1fb9848387a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.528658 22892 tablet_service.cc:1467] Processing CreateTablet for tablet b40002b2a71741d9833974adc89e0c4e (DEFAULT_TABLE table=default.Table_d90a9cd4efd54c5fae3e012693cea10a [id=54cb1bc41617475294f6b87b15864901]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.528856 22898 tablet_service.cc:1467] Processing CreateTablet for tablet d19c73dce51147e29837df3b364af790 (DEFAULT_TABLE table=default.Table_44a18784001e45b3a8c92835db52640c [id=412aa24e1d20476ab4b6bfaf07c72e22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.529018 23036 tablet_bootstrap.cc:654] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.529054 22896 tablet_service.cc:1467] Processing CreateTablet for tablet c84208a885c54f6c8dfde6f91b1c938a (DEFAULT_TABLE table=default.Table_2ab7b7c9de6a4ef0af72a85800f3a067 [id=3a02f0bc71554fb4a90c388ed1ad3a11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.529274 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 (DEFAULT_TABLE table=default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.529524 22887 tablet_service.cc:1467] Processing CreateTablet for tablet 458bbc607af0400d93fe7990999d90b9 (DEFAULT_TABLE table=default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.529585 23038 ts_tablet_manager.cc:1918] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.569357 23038 log.cc:1198] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.569569 23038 ts_tablet_manager.cc:1939] T 1e2e8bde44bc453fa202d8c81356ad3b P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.529752 22886 tablet_service.cc:1467] Processing CreateTablet for tablet 77617388a31447f196febf2980f3f410 (DEFAULT_TABLE table=default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.529969 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530128 22884 tablet_service.cc:1467] Processing CreateTablet for tablet 43b4420df3e84c1888043baa9f2dd692 (DEFAULT_TABLE table=default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530285 22883 tablet_service.cc:1467] Processing CreateTablet for tablet 65b0da9ee2d545e8acef16ad06ac1966 (DEFAULT_TABLE table=default.Table_e1696bafd2c7402ca2222344c4db901d [id=16cfbc372c994f5fb305c70cdadd0abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530426 22882 tablet_service.cc:1467] Processing CreateTablet for tablet e4598f42f64b4354af0cfb53826d59e3 (DEFAULT_TABLE table=default.Table_c65081e9a22142babc740190cb3a96b7 [id=3a53c2f5d23c457eb8621b1f017badf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530582 22881 tablet_service.cc:1467] Processing CreateTablet for tablet 32063752131c417abd32c5f0a8400adc (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530721 22880 tablet_service.cc:1467] Processing CreateTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.530872 22879 tablet_service.cc:1467] Processing CreateTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e (DEFAULT_TABLE table=default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.570073 23134 consensus_queue.cc:1035] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.568378 23040 tablet_replica.cc:331] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.530966 23084 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.570384 23040 raft_consensus.cc:2238] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.570451 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 65b0da9ee2d545e8acef16ad06ac1966 (DEFAULT_TABLE table=default.Table_e1696bafd2c7402ca2222344c4db901d [id=16cfbc372c994f5fb305c70cdadd0abc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.531296 22890 tablet_service.cc:1467] Processing CreateTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d (DEFAULT_TABLE table=default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.570664 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0da9ee2d545e8acef16ad06ac1966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.531734 22889 tablet_service.cc:1467] Processing CreateTablet for tablet b6d8f7cf39be44cc8bbae6e68e97beb2 (DEFAULT_TABLE table=default.Table_6dca3743bd384f20844603fc314e151f [id=49b0143652e8448c90bffd51818c4662]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.570765 23040 raft_consensus.cc:2267] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.531805 22891 tablet_service.cc:1467] Processing CreateTablet for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (DEFAULT_TABLE table=default.Table_b44cd661c42a45b480baa1ea160d909f [id=95803b5342bb4561be8bc0478cc8ca6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.532069 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 92cbead1e7a04ee58645c8a03fbfd71e (DEFAULT_TABLE table=default.Table_96d34d168eab498ea95aac82aa02ba0d [id=ec21b6bc33d74ccdac2ae1e2b69956e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.572362 23040 ts_tablet_manager.cc:1905] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.572853 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdbdb92c2f5441796e20643a5e02a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.532291 22897 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 (DEFAULT_TABLE table=default.Table_57c9487892f843288e0eda879e5f3164 [id=8a74c5a816684dd995d043af0acf9891]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.565701 23356 tablet.cc:1721] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.574127 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 8fe1bc020af84f039e1560c7ae4f9176 (table default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]) successfully deleted
I20250112 21:02:31.574249 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet f0f97254c55a47b5a5e96796ec18b049 (table default.Table_75dbe00b4ac144fda1277b451c425944 [id=7b5374dc44b047beb34d09070f6067a5]) successfully deleted
I20250112 21:02:31.574350 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 3f84f8f5e44e4d30bacf77072a86765d (table default.Table_02d4dc14615749259db8519e1657df57 [id=bbdca7c683c946c98e61f270465e21e4]) successfully deleted
I20250112 21:02:31.577030 23034 tablet_bootstrap.cc:654] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.577239 22754 tablet_service.cc:1467] Processing CreateTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.577484 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d7de8faa34adcb63f76151d8ab5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.579327 23036 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.579421 23036 ts_tablet_manager.cc:1397] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.052s user 0.000s sys 0.002s
I20250112 21:02:31.579906 23036 raft_consensus.cc:357] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.580013 23036 raft_consensus.cc:383] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.580049 23036 raft_consensus.cc:738] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.580163 23036 consensus_queue.cc:260] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.580219 22753 tablet_service.cc:1467] Processing CreateTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 (DEFAULT_TABLE table=default.Table_5487430f075043b691e493891c986d07 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.580449 23036 ts_tablet_manager.cc:1428] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.580473 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aad32a4d5f40c69b28219f0cc42538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.580915 22755 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5332ec945740f0a998b1fb9848387a (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.581125 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5332ec945740f0a998b1fb9848387a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.582863 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db56f76b0b7473bb5d70463ec5b2484. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.583139 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458bbc607af0400d93fe7990999d90b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.583298 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77617388a31447f196febf2980f3f410. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.583418 22898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19c73dce51147e29837df3b364af790. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.583568 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 56914e0635284561adb64897a0dfe37c (DEFAULT_TABLE table=default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.583762 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56914e0635284561adb64897a0dfe37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.584422 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b4420df3e84c1888043baa9f2dd692. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.584595 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84208a885c54f6c8dfde6f91b1c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.585227 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65b0da9ee2d545e8acef16ad06ac1966. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.586695 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbf428b373d462ca89bd39795c6ed31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.587136 22757 tablet_service.cc:1467] Processing CreateTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e (DEFAULT_TABLE table=default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.587363 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5515bf0f1f5419d9af6b3d82fa33e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.588303 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b40002b2a71741d9833974adc89e0c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.588956 23040 ts_tablet_manager.cc:1918] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250112 21:02:31.589021 23040 log.cc:1198] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/11f19de7823b40c1ba7ed03d2d8adfcd
I20250112 21:02:31.589258 23040 ts_tablet_manager.cc:1939] T 11f19de7823b40c1ba7ed03d2d8adfcd P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.589411 23034 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.589485 23034 ts_tablet_manager.cc:1397] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20250112 21:02:31.589767 23040 tablet_replica.cc:331] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.589887 23040 raft_consensus.cc:2238] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.589905 23034 raft_consensus.cc:357] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.589978 23040 raft_consensus.cc:2267] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.590049 23034 raft_consensus.cc:383] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.590102 23034 raft_consensus.cc:738] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.590237 23034 consensus_queue.cc:260] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.591029 23034 ts_tablet_manager.cc:1428] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.591006 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 56914e0635284561adb64897a0dfe37c (DEFAULT_TABLE table=default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.591209 22896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56914e0635284561adb64897a0dfe37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.591229 23034 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.591670 22887 tablet_service.cc:1467] Processing CreateTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 (DEFAULT_TABLE table=default.Table_5487430f075043b691e493891c986d07 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.591852 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aad32a4d5f40c69b28219f0cc42538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.592149 23034 tablet_bootstrap.cc:654] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.592924 22881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32063752131c417abd32c5f0a8400adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.594612 22880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d7de8faa34adcb63f76151d8ab5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.596308 22879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5515bf0f1f5419d9af6b3d82fa33e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.597934 23134 raft_consensus.cc:491] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.598001 23134 raft_consensus.cc:513] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.598323 23134 leader_election.cc:290] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.598362 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet 0ce0379839924289921a2f75c986953a from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.598809 23038 tablet_replica.cc:331] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.598920 23038 raft_consensus.cc:2238] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.599002 23038 raft_consensus.cc:2267] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.599123 23118 raft_consensus.cc:491] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.599200 23118 raft_consensus.cc:513] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.599444 23038 ts_tablet_manager.cc:1905] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.599563 23118 leader_election.cc:290] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.600278 22890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a29dbc7d2a6f4ab2b645958e69665d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.601596 23038 ts_tablet_manager.cc:1918] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.601655 23038 log.cc:1198] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/abeeebb5039b4ca38450a0f727d1e0fd
I20250112 21:02:31.601827 23038 ts_tablet_manager.cc:1939] T abeeebb5039b4ca38450a0f727d1e0fd P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.602346 23265 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 1 FOLLOWER]: Advancing to term 2
I20250112 21:02:31.602735 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d8f7cf39be44cc8bbae6e68e97beb2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:31.602751 22580 leader_election.cc:343] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.602283 23038 tablet_replica.cc:331] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.602924 23038 raft_consensus.cc:2238] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.603049 23038 pending_rounds.cc:62] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Trying to abort 1 pending ops.
I20250112 21:02:31.603076 23038 pending_rounds.cc:69] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587718005112832 op_type: NO_OP noop_request { }
I20250112 21:02:31.603122 23038 raft_consensus.cc:2883] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.603168 23038 raft_consensus.cc:2267] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.603813 23038 ts_tablet_manager.cc:1905] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.604748 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f292d9ff408488a84d432050ab317fc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.605181 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d4e55df14b84ca9af9fb2ee73022bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.605433 23038 ts_tablet_manager.cc:1918] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.605492 23038 log.cc:1198] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.605767 23038 ts_tablet_manager.cc:1939] T 04616ed61b134e889503c3b336ad4054 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.606932 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92cbead1e7a04ee58645c8a03fbfd71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.607142 22613 tablet_service.cc:1467] Processing CreateTablet for tablet e4598f42f64b4354af0cfb53826d59e3 (DEFAULT_TABLE table=default.Table_c65081e9a22142babc740190cb3a96b7 [id=3a53c2f5d23c457eb8621b1f017badf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.607381 22613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4598f42f64b4354af0cfb53826d59e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.607395 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f292d9ff408488a84d432050ab317fc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:31.608834 22851 leader_election.cc:343] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.609259 23135 raft_consensus.cc:491] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.609349 23135 raft_consensus.cc:513] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.609377 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 32063752131c417abd32c5f0a8400adc (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.609568 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32063752131c417abd32c5f0a8400adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.609670 23135 leader_election.cc:290] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.609751 23135 consensus_queue.cc:1035] T fbbcbb54b752415b8b97cc7e99df5318 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.610066 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdbdb92c2f5441796e20643a5e02a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.610114 23036 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.610353 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 32063752131c417abd32c5f0a8400adc (DEFAULT_TABLE table=default.Table_f94af44918694b88b8d57027a6ad4d4b [id=dba651f852754c88abc6887c7e668338]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.610594 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32063752131c417abd32c5f0a8400adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.610976 23036 tablet_bootstrap.cc:654] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.611326 22626 tablet_service.cc:1467] Processing CreateTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.611517 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5d7de8faa34adcb63f76151d8ab5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.611871 22619 tablet_service.cc:1467] Processing CreateTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e (DEFAULT_TABLE table=default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.612048 22619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5515bf0f1f5419d9af6b3d82fa33e7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.613330 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 7d5332ec945740f0a998b1fb9848387a (DEFAULT_TABLE table=default.Table_c66934d30a0b43e283881965d2d1628e [id=4b037255e8f8414a8b56f05f1354c9cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.613459 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (table default.Table_151bce48dcde41a0841fdbd516d209fc [id=ac0d0569964b4de4bed1988303be50d0]). Expected version 1 got 0
I20250112 21:02:31.613523 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d5332ec945740f0a998b1fb9848387a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.613922 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 56914e0635284561adb64897a0dfe37c (DEFAULT_TABLE table=default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.614104 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56914e0635284561adb64897a0dfe37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.615257 22614 tablet_service.cc:1467] Processing CreateTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 (DEFAULT_TABLE table=default.Table_5487430f075043b691e493891c986d07 [id=8ef8b7c86df94166b526d83a12e78cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.615440 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aad32a4d5f40c69b28219f0cc42538. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.616190 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 1f164e6da7724fa8996766a41a0c214a (table default.Table_3f4664e903e641f49a309dfa855e3266 [id=c8c5c1c9ecd644c9a0918747b9fcd48b]) successfully deleted
I20250112 21:02:31.616587 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 11f19de7823b40c1ba7ed03d2d8adfcd (table default.Table_c2ec60f264e4444e85dd3dbcf3cc4b9c [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:31.616950 23036 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.617022 23036 ts_tablet_manager.cc:1397] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:31.617465 23036 raft_consensus.cc:357] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.617551 23036 raft_consensus.cc:383] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.617579 23036 raft_consensus.cc:738] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.617674 23036 consensus_queue.cc:260] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.617913 23036 ts_tablet_manager.cc:1428] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.618052 23036 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.618217 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:31.618340 23345 mvcc.cc:204] Tried to move back new op lower bound from 7113587718159142912 to 7113587717316112384. Current Snapshot: MvccSnapshot[applied={T|T < 7113587718159142912}]
I20250112 21:02:31.618501 22463 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:31.618868 23036 tablet_bootstrap.cc:654] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.618880 23354 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.619313 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 2faf8cc5d3604e7ab814be894c842fc2
I20250112 21:02:31.619341 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4598f42f64b4354af0cfb53826d59e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.619550 22464 catalog_manager.cc:6596] ReplaceTablet: tablet 2faf8cc5d3604e7ab814be894c842fc2 deleted and replaced by tablet bd52409ed391433491b65bb00d33b36a
I20250112 21:02:31.621243 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.621331 22461 master_service.cc:946] ReplaceTablet: received request to replace tablet 3f292d9ff408488a84d432050ab317fc from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.622560 23040 ts_tablet_manager.cc:1905] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:31.623286 22851 leader_election.cc:343] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.623354 22851 leader_election.cc:304] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.623733 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.623867 22782 raft_consensus.cc:2388] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3423673c659e4427958b13fc9eaa714d in current term 1: Already voted for candidate d8faec3969b64c33a4bf9aba509785ea in this term.
I20250112 21:02:31.624168 23134 raft_consensus.cc:2743] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.625100 23040 ts_tablet_manager.cc:1918] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.625165 23040 log.cc:1198] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/d53dd4efde384b5d911f82e8d88326b8
I20250112 21:02:31.625972 22914 raft_consensus.cc:3054] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.627067 23040 ts_tablet_manager.cc:1939] T d53dd4efde384b5d911f82e8d88326b8 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.627558 23040 tablet_replica.cc:331] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
W20250112 21:02:31.627823 22582 leader_election.cc:343] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: 1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.627888 22582 leader_election.cc:304] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.628046 23118 raft_consensus.cc:2743] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.628391 23084 tablet.cc:1721] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.629135 23040 raft_consensus.cc:2238] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
W20250112 21:02:31.629165 22460 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 56914e0635284561adb64897a0dfe37c consensus state has no leader
I20250112 21:02:31.629303 23040 raft_consensus.cc:2267] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.629334 22460 master_service.cc:946] ReplaceTablet: received request to replace tablet bdeb12d12d3244dbac58127ebeb662cd from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.629837 23040 ts_tablet_manager.cc:1905] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.633167 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 1e2e8bde44bc453fa202d8c81356ad3b (table default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]) successfully deleted
I20250112 21:02:31.633407 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet abeeebb5039b4ca38450a0f727d1e0fd (table default.Table_19b0a72a5b4547e2925b2761711c4951 [id=a34fe8525b16448eb589cd0b380d1ee0]) successfully deleted
I20250112 21:02:31.633553 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 04616ed61b134e889503c3b336ad4054 (table default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]) successfully deleted
I20250112 21:02:31.634088 22884 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.634246 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet bd52409ed391433491b65bb00d33b36a) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.634368 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.634404 23038 tablet_replica.cc:331] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.634521 23038 raft_consensus.cc:2238] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.634613 23038 raft_consensus.cc:2267] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.634652 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2faf8cc5d3604e7ab814be894c842fc2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.635202 22851 leader_election.cc:304] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
W20250112 21:02:31.635296 22851 raft_consensus.cc:2681] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250112 21:02:31.635730 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet d53dd4efde384b5d911f82e8d88326b8 (table default.Table_77196fc27b3c43a18dc33dedc28330e0 [id=ba7360d4d2ea4e8d97026628ebd39bd9]) successfully deleted
I20250112 21:02:31.636010 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.636036 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet bd52409ed391433491b65bb00d33b36a) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.636237 23038 ts_tablet_manager.cc:1905] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.636251 23040 ts_tablet_manager.cc:1918] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.636300 23040 log.cc:1198] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.636497 23040 ts_tablet_manager.cc:1939] T 04616ed61b134e889503c3b336ad4054 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.636943 23040 tablet_replica.cc:331] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.637056 23040 raft_consensus.cc:2238] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.637140 23040 raft_consensus.cc:2267] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.637194 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 04616ed61b134e889503c3b336ad4054 (table default.Table_d44d3f76b31747b784d209adf5c87d92 [id=d37fbd83c544480188b40f3c982d9151]) successfully deleted
I20250112 21:02:31.638213 23038 ts_tablet_manager.cc:1918] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.638283 23038 log.cc:1198] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/2faf8cc5d3604e7ab814be894c842fc2
I20250112 21:02:31.638464 23038 ts_tablet_manager.cc:1939] T 2faf8cc5d3604e7ab814be894c842fc2 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.638733 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
W20250112 21:02:31.639156 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet f0aad32a4d5f40c69b28219f0cc42538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0aad32a4d5f40c69b28219f0cc42538 already in progress: creating tablet
I20250112 21:02:31.639225 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 2faf8cc5d3604e7ab814be894c842fc2 with delete_type TABLET_DATA_DELETED (replaced by tablet bd52409ed391433491b65bb00d33b36a) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.639372 23039 tablet_replica.cc:331] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.639483 23039 raft_consensus.cc:2238] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.639572 23039 raft_consensus.cc:2267] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.639882 23039 ts_tablet_manager.cc:1905] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.641100 23034 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.641173 23034 ts_tablet_manager.cc:1397] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20250112 21:02:31.641570 23034 raft_consensus.cc:357] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.641654 23034 raft_consensus.cc:383] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.641677 23034 raft_consensus.cc:738] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.641782 23034 consensus_queue.cc:260] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.641860 23039 ts_tablet_manager.cc:1918] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.641916 23039 log.cc:1198] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/2faf8cc5d3604e7ab814be894c842fc2
I20250112 21:02:31.642001 23034 ts_tablet_manager.cc:1428] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.642082 23039 ts_tablet_manager.cc:1939] T 2faf8cc5d3604e7ab814be894c842fc2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.642148 23034 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:31.642889 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet dfdbdb92c2f5441796e20643a5e02a80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfdbdb92c2f5441796e20643a5e02a80 already in progress: creating tablet
I20250112 21:02:31.642998 23034 tablet_bootstrap.cc:654] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.643023 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 2faf8cc5d3604e7ab814be894c842fc2 (table default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]) successfully deleted
W20250112 21:02:31.643155 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet f0aad32a4d5f40c69b28219f0cc42538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0aad32a4d5f40c69b28219f0cc42538 already in progress: creating tablet
I20250112 21:02:31.644558 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 2faf8cc5d3604e7ab814be894c842fc2 (table default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]) successfully deleted
I20250112 21:02:31.645421 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet dfdbdb92c2f5441796e20643a5e02a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.645615 23039 tablet_replica.cc:331] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.645750 23039 raft_consensus.cc:2238] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.645862 23039 raft_consensus.cc:2267] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.646262 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 159ed04aaf0447ad9b016d39f3271aaf
I20250112 21:02:31.646515 23040 ts_tablet_manager.cc:1905] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.646538 22458 catalog_manager.cc:6596] ReplaceTablet: tablet 159ed04aaf0447ad9b016d39f3271aaf deleted and replaced by tablet 1d3f9cdd5b59474f953fa0099553262f
I20250112 21:02:31.646755 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf with delete_type TABLET_DATA_DELETED (replaced by tablet 1d3f9cdd5b59474f953fa0099553262f) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.646766 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_1598432ed2274fe2b9d2ab0c1867100d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.646868 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf with delete_type TABLET_DATA_DELETED (replaced by tablet 1d3f9cdd5b59474f953fa0099553262f) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:31.647117 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1598432ed2274fe2b9d2ab0c1867100d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.647814 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet a29dbc7d2a6f4ab2b645958e69665d8d
I20250112 21:02:31.648212 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_3fb2f846f6b64ccd953c87ac3c974c10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.648298 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.648427 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:31.648548 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fb2f846f6b64ccd953c87ac3c974c10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.648772 23040 ts_tablet_manager.cc:1918] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.648825 23040 log.cc:1198] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/abeeebb5039b4ca38450a0f727d1e0fd
I20250112 21:02:31.648990 23040 ts_tablet_manager.cc:1939] T abeeebb5039b4ca38450a0f727d1e0fd P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.649186 22457 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6d6ded240a0e4bad9e54e81185ef732f
I20250112 21:02:31.649385 22457 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_0777a5d7db50457e90b14bcbccd77c8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.649663 22457 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0777a5d7db50457e90b14bcbccd77c8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.650005 23036 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.650103 23036 ts_tablet_manager.cc:1397] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20250112 21:02:31.650523 23036 raft_consensus.cc:357] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.650626 23036 raft_consensus.cc:383] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.650655 23036 raft_consensus.cc:738] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.650763 23036 consensus_queue.cc:260] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.650897 22459 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet bdeb12d12d3244dbac58127ebeb662cd
I20250112 21:02:31.650986 23036 ts_tablet_manager.cc:1428] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.651127 23036 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.651135 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_2184cbe9f8a041edb513e7c827672a4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.651407 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2184cbe9f8a041edb513e7c827672a4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.651665 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet bdeb12d12d3244dbac58127ebeb662cd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.651964 23036 tablet_bootstrap.cc:654] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.652650 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet bdeb12d12d3244dbac58127ebeb662cd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.653067 23036 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.653137 23036 ts_tablet_manager.cc:1397] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250112 21:02:31.653609 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0ce0379839924289921a2f75c986953a
I20250112 21:02:31.653837 22462 catalog_manager.cc:6596] ReplaceTablet: tablet 0ce0379839924289921a2f75c986953a deleted and replaced by tablet 55779970251c4f819e1e3405de0bc30b
I20250112 21:02:31.653895 23135 raft_consensus.cc:491] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.653961 23135 raft_consensus.cc:513] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.654268 23135 leader_election.cc:290] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.654474 23049 raft_consensus.cc:491] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.654542 23049 raft_consensus.cc:513] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.654893 23049 leader_election.cc:290] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.655396 23039 ts_tablet_manager.cc:1905] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.655723 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.655853 22917 raft_consensus.cc:2463] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.656507 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet 159ed04aaf0447ad9b016d39f3271aaf with delete_type TABLET_DATA_DELETED (replaced by tablet 1d3f9cdd5b59474f953fa0099553262f) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.656656 23038 tablet_replica.cc:331] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.656773 23038 raft_consensus.cc:2238] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.656867 23038 raft_consensus.cc:2267] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.657061 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.657260 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.657320 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce0379839924289921a2f75c986953a with delete_type TABLET_DATA_DELETED (replaced by tablet 55779970251c4f819e1e3405de0bc30b) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.657379 22782 raft_consensus.cc:2463] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:31.657841 22580 leader_election.cc:304] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.658295 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.658406 22782 raft_consensus.cc:2463] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.658627 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.658738 22646 raft_consensus.cc:2463] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.659046 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_151bce48dcde41a0841fdbd516d209fc" } new_table_name: "default.Table_432e86f6f4fa45f3af6f00d27341ac47" modify_external_catalogs: true
I20250112 21:02:31.659075 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_671c0651b8794b30baddd5497d7418c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.659350 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_671c0651b8794b30baddd5497d7418c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.659621 22851 leader_election.cc:304] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.659876 23135 raft_consensus.cc:2798] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.659919 23135 raft_consensus.cc:491] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.659951 23135 raft_consensus.cc:3054] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.659991 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet bdeb12d12d3244dbac58127ebeb662cd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.660128 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce0379839924289921a2f75c986953a with delete_type TABLET_DATA_DELETED (replaced by tablet 55779970251c4f819e1e3405de0bc30b) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.660936 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.660909 23135 raft_consensus.cc:513] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.661201 23135 leader_election.cc:290] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.661235 22461 catalog_manager.cc:6596] ReplaceTablet: tablet 3f292d9ff408488a84d432050ab317fc deleted and replaced by tablet 5e6369517eed414295e2b23769bb5cf6
I20250112 21:02:31.661375 22464 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c] alter complete (version 1)
I20250112 21:02:31.661382 23118 raft_consensus.cc:2798] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.661430 23118 raft_consensus.cc:491] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.661463 23118 raft_consensus.cc:3054] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.661589 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f292d9ff408488a84d432050ab317fc with delete_type TABLET_DATA_DELETED (replaced by tablet 5e6369517eed414295e2b23769bb5cf6) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.662351 23118 raft_consensus.cc:513] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.662663 23118 leader_election.cc:290] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.663093 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.663108 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.663190 22781 raft_consensus.cc:3054] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.663249 22917 raft_consensus.cc:2388] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8faec3969b64c33a4bf9aba509785ea in current term 1: Already voted for candidate 3423673c659e4427958b13fc9eaa714d in this term.
I20250112 21:02:31.663798 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f292d9ff408488a84d432050ab317fc with delete_type TABLET_DATA_DELETED (replaced by tablet 5e6369517eed414295e2b23769bb5cf6) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.664033 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet 04616ed61b134e889503c3b336ad4054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.664090 22781 raft_consensus.cc:2463] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:31.664842 22464 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 2 got 0
I20250112 21:02:31.665155 23039 ts_tablet_manager.cc:1918] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.665211 23039 log.cc:1198] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:31.665382 23039 ts_tablet_manager.cc:1939] T dfdbdb92c2f5441796e20643a5e02a80 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
W20250112 21:02:31.665621 22580 consensus_peers.cc:487] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea -> Peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Couldn't send request to peer 0b63e675bcb141f3a7887ea5ef9ed2df. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2faf8cc5d3604e7ab814be894c842fc2. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.665648 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.665776 22646 raft_consensus.cc:2388] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3423673c659e4427958b13fc9eaa714d in current term 1: Already voted for candidate d8faec3969b64c33a4bf9aba509785ea in this term.
I20250112 21:02:31.665755 22580 leader_election.cc:304] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.653520 23036 raft_consensus.cc:357] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.665982 23036 raft_consensus.cc:383] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.666021 23036 raft_consensus.cc:738] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.666139 23036 consensus_queue.cc:260] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.666400 23036 ts_tablet_manager.cc:1428] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20250112 21:02:31.666568 23036 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.667050 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_85a014a4190e4ea684afc43dd0349122"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.667750 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85a014a4190e4ea684afc43dd0349122 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.668042 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a0e4f4b5f194bb99049fecc2b256b08" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.668154 22781 raft_consensus.cc:2388] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3423673c659e4427958b13fc9eaa714d in current term 1: Already voted for candidate d8faec3969b64c33a4bf9aba509785ea in this term.
I20250112 21:02:31.668445 22851 leader_election.cc:304] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.668751 23134 raft_consensus.cc:2743] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.668377 23118 raft_consensus.cc:2798] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.668876 23118 raft_consensus.cc:695] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:31.669009 23118 consensus_queue.cc:237] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.671434 22463 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_151bce48dcde41a0841fdbd516d209fc [id=ac0d0569964b4de4bed1988303be50d0] alter complete (version 1)
W20250112 21:02:31.672030 22464 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 458bbc607af0400d93fe7990999d90b9 consensus state has no leader
I20250112 21:02:31.673305 23036 tablet_bootstrap.cc:654] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.674089 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f292d9ff408488a84d432050ab317fc with delete_type TABLET_DATA_DELETED (replaced by tablet 5e6369517eed414295e2b23769bb5cf6) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.674947 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ce0379839924289921a2f75c986953a with delete_type TABLET_DATA_DELETED (replaced by tablet 55779970251c4f819e1e3405de0bc30b) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.675653 22460 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 56914e0635284561adb64897a0dfe37c (table default.Table_43fd2301070a49119af5f07230e04cd0 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 4 got 0
I20250112 21:02:31.675695 22458 catalog_manager.cc:5526] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea reported cstate change: term changed from 0 to 1, leader changed from <none> to d8faec3969b64c33a4bf9aba509785ea (127.21.194.193). New cstate: current_term: 1 leader_uuid: "d8faec3969b64c33a4bf9aba509785ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:31.675877 23039 tablet_replica.cc:331] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.675846 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_7a1433e05e434f459f40014712bafb56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.675997 23039 raft_consensus.cc:2238] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.676120 23039 raft_consensus.cc:2267] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:31.676126 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a1433e05e434f459f40014712bafb56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.676550 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet dfdbdb92c2f5441796e20643a5e02a80 (table default.Table_57c9487892f843288e0eda879e5f3164 [id=8a74c5a816684dd995d043af0acf9891]) successfully deleted
I20250112 21:02:31.676851 23039 ts_tablet_manager.cc:1905] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.675661 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_77196fc27b3c43a18dc33dedc28330e0" } new_table_name: "default.Table_7ea81deebf984428977ec9cb0172d4a7" modify_external_catalogs: true
I20250112 21:02:31.679622 23039 ts_tablet_manager.cc:1918] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.679733 23039 log.cc:1198] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/159ed04aaf0447ad9b016d39f3271aaf
I20250112 21:02:31.679998 23039 ts_tablet_manager.cc:1939] T 159ed04aaf0447ad9b016d39f3271aaf P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.680629 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:31.680660 23039 tablet_replica.cc:331] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.680879 23039 raft_consensus.cc:2238] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.681027 23039 raft_consensus.cc:2267] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.681663 23039 ts_tablet_manager.cc:1905] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.683457 23039 ts_tablet_manager.cc:1918] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.683565 23039 log.cc:1198] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/a29dbc7d2a6f4ab2b645958e69665d8d
I20250112 21:02:31.683780 23039 ts_tablet_manager.cc:1939] T a29dbc7d2a6f4ab2b645958e69665d8d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.683979 23135 raft_consensus.cc:491] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.684058 23135 raft_consensus.cc:513] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.684374 23135 leader_election.cc:290] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.684428 23039 tablet_replica.cc:331] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.684356 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet a29dbc7d2a6f4ab2b645958e69665d8d (table default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]) successfully deleted
I20250112 21:02:31.684535 23039 raft_consensus.cc:2238] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.684628 23039 raft_consensus.cc:2267] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.684857 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:31.685317 22851 leader_election.cc:343] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.685539 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
W20250112 21:02:31.685654 22465 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5515bf0f1f5419d9af6b3d82fa33e7e consensus state has no leader
I20250112 21:02:31.685671 23039 ts_tablet_manager.cc:1905] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:31.686041 22851 leader_election.cc:343] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.686111 22851 leader_election.cc:304] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.686331 23135 raft_consensus.cc:2743] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250112 21:02:31.687023 23416 consensus_queue.cc:1159] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3423673c659e4427958b13fc9eaa714d" status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20250112 21:02:31.690178 23039 ts_tablet_manager.cc:1918] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.690291 23039 log.cc:1198] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/bdeb12d12d3244dbac58127ebeb662cd
I20250112 21:02:31.690333 23356 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.690448 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 82bc4bbfe26c435a906dbf3312cc3d5a (table default.Table_432e86f6f4fa45f3af6f00d27341ac47 [id=ac0d0569964b4de4bed1988303be50d0]). Expected version 2 got 1
I20250112 21:02:31.690563 23039 ts_tablet_manager.cc:1939] T bdeb12d12d3244dbac58127ebeb662cd P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.691217 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet bdeb12d12d3244dbac58127ebeb662cd (table default.Table_d73f9b21518a49e798e5dff732a78293 [id=75df653ef27a498a96a8725368b32a4b]) successfully deleted
I20250112 21:02:31.691309 23039 tablet_replica.cc:331] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
W20250112 21:02:31.691360 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 3f292d9ff408488a84d432050ab317fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f292d9ff408488a84d432050ab317fc already in progress: creating tablet
I20250112 21:02:31.691406 23039 raft_consensus.cc:2238] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.691505 23039 raft_consensus.cc:2267] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.692107 23039 ts_tablet_manager.cc:1905] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.693991 23039 ts_tablet_manager.cc:1918] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:31.694103 23039 log.cc:1198] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0ce0379839924289921a2f75c986953a
I20250112 21:02:31.694381 23039 ts_tablet_manager.cc:1939] T 0ce0379839924289921a2f75c986953a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.694555 23406 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.694963 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0ce0379839924289921a2f75c986953a (table default.Table_334064033b144ee1af033570e8132ce6 [id=490ed39e4b39477896146f5b117fb296]) successfully deleted
I20250112 21:02:31.695070 23354 tablet.cc:1721] T 82bc4bbfe26c435a906dbf3312cc3d5a P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:31.696995 23034 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.697072 23034 ts_tablet_manager.cc:1397] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20250112 21:02:31.697497 23034 raft_consensus.cc:357] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.697587 23034 raft_consensus.cc:383] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.697613 23034 raft_consensus.cc:738] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.697710 23034 consensus_queue.cc:260] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.697932 23034 ts_tablet_manager.cc:1428] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.697913 22462 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_432e86f6f4fa45f3af6f00d27341ac47 [id=ac0d0569964b4de4bed1988303be50d0] alter complete (version 2)
I20250112 21:02:31.698058 23034 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.698874 23034 tablet_bootstrap.cc:654] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.702031 23034 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.702097 23034 ts_tablet_manager.cc:1397] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:31.702481 23034 raft_consensus.cc:357] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.702581 23034 raft_consensus.cc:383] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.702606 23034 raft_consensus.cc:738] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.702699 23034 consensus_queue.cc:260] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.702917 23034 ts_tablet_manager.cc:1428] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.703039 23034 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.703868 23034 tablet_bootstrap.cc:654] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.703934 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_7ea81deebf984428977ec9cb0172d4a7" } new_table_name: "default.Table_f29a6392084f462fadb2d8d4ab6da8c6" modify_external_catalogs: true
I20250112 21:02:31.705447 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c85c6a076cbb4a1fa4d31c684995ad5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.705771 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c85c6a076cbb4a1fa4d31c684995ad5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.705821 22461 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d90a9cd4efd54c5fae3e012693cea10a" } new_table_name: "default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf" modify_external_catalogs: true
I20250112 21:02:31.707351 23034 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.707420 23034 ts_tablet_manager.cc:1397] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:31.707782 23034 raft_consensus.cc:357] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.707862 23034 raft_consensus.cc:383] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.707888 23034 raft_consensus.cc:738] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.707999 23034 consensus_queue.cc:260] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.708205 23034 ts_tablet_manager.cc:1428] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.708341 23034 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:31.708469 22465 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5515bf0f1f5419d9af6b3d82fa33e7e consensus state has no leader
I20250112 21:02:31.709365 23034 tablet_bootstrap.cc:654] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:31.710834 22461 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b40002b2a71741d9833974adc89e0c4e consensus state has no leader
I20250112 21:02:31.711896 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f292d9ff408488a84d432050ab317fc with delete_type TABLET_DATA_DELETED (replaced by tablet 5e6369517eed414295e2b23769bb5cf6) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.712674 23039 tablet_replica.cc:331] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.712813 23039 raft_consensus.cc:2238] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.712920 23039 raft_consensus.cc:2267] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.713287 23039 ts_tablet_manager.cc:1905] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.714993 23034 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.715116 23034 ts_tablet_manager.cc:1397] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250112 21:02:31.715265 23039 ts_tablet_manager.cc:1918] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.715359 23039 log.cc:1198] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.715576 23039 ts_tablet_manager.cc:1939] T 3f292d9ff408488a84d432050ab317fc P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.715677 23034 raft_consensus.cc:357] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.715816 23034 raft_consensus.cc:383] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.715886 23034 raft_consensus.cc:738] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.715947 23038 ts_tablet_manager.cc:1905] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.716146 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 3f292d9ff408488a84d432050ab317fc (table default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]) successfully deleted
I20250112 21:02:31.716178 23034 consensus_queue.cc:260] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.717741 23034 ts_tablet_manager.cc:1428] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:31.717913 23038 ts_tablet_manager.cc:1918] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.717983 23038 log.cc:1198] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/159ed04aaf0447ad9b016d39f3271aaf
I20250112 21:02:31.718201 23038 ts_tablet_manager.cc:1939] T 159ed04aaf0447ad9b016d39f3271aaf P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.718353 23034 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.718786 23038 tablet_replica.cc:331] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.718889 23038 raft_consensus.cc:2238] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.719056 23038 raft_consensus.cc:2267] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.719229 23034 tablet_bootstrap.cc:654] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.719264 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
W20250112 21:02:31.719429 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet a29dbc7d2a6f4ab2b645958e69665d8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a29dbc7d2a6f4ab2b645958e69665d8d already in progress: creating tablet
I20250112 21:02:31.719839 23038 ts_tablet_manager.cc:1905] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.721597 23038 ts_tablet_manager.cc:1918] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.721664 23038 log.cc:1198] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/bdeb12d12d3244dbac58127ebeb662cd
I20250112 21:02:31.722051 23038 ts_tablet_manager.cc:1939] T bdeb12d12d3244dbac58127ebeb662cd P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.722550 23038 tablet_replica.cc:331] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.722628 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet bdeb12d12d3244dbac58127ebeb662cd (table default.Table_d73f9b21518a49e798e5dff732a78293 [id=75df653ef27a498a96a8725368b32a4b]) successfully deleted
I20250112 21:02:31.722703 23038 raft_consensus.cc:2238] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.722904 23038 raft_consensus.cc:2267] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.723505 23038 ts_tablet_manager.cc:1905] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.724951 23034 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.725028 23034 ts_tablet_manager.cc:1397] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:31.725119 23038 ts_tablet_manager.cc:1918] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:31.725188 23038 log.cc:1198] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/0ce0379839924289921a2f75c986953a
I20250112 21:02:31.725404 23034 raft_consensus.cc:357] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.725497 23034 raft_consensus.cc:383] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.725526 23034 raft_consensus.cc:738] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.725431 23038 ts_tablet_manager.cc:1939] T 0ce0379839924289921a2f75c986953a P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.725646 23034 consensus_queue.cc:260] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.725893 23034 ts_tablet_manager.cc:1428] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.726063 23034 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.726152 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 0ce0379839924289921a2f75c986953a (table default.Table_334064033b144ee1af033570e8132ce6 [id=490ed39e4b39477896146f5b117fb296]) successfully deleted
I20250112 21:02:31.726542 23037 tablet_bootstrap.cc:492] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.726631 23037 ts_tablet_manager.cc:1397] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.164s user 0.001s sys 0.000s
I20250112 21:02:31.726936 23034 tablet_bootstrap.cc:654] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.727031 23037 raft_consensus.cc:357] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.727123 23037 raft_consensus.cc:383] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.727150 23037 raft_consensus.cc:738] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.727255 23037 consensus_queue.cc:260] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.727490 23037 ts_tablet_manager.cc:1428] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.727648 23037 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.730446 23037 tablet_bootstrap.cc:654] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.731426 23037 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.731643 23037 ts_tablet_manager.cc:1397] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250112 21:02:31.732081 23037 raft_consensus.cc:357] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.732342 23037 raft_consensus.cc:383] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.732447 23037 raft_consensus.cc:738] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.732671 23038 tablet_replica.cc:331] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.732622 23037 consensus_queue.cc:260] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.732909 23038 raft_consensus.cc:2238] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.733039 23038 raft_consensus.cc:2267] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.734179 23038 ts_tablet_manager.cc:1905] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.734728 23037 ts_tablet_manager.cc:1428] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250112 21:02:31.736855 23036 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.736881 23037 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.736986 23034 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.737073 23034 ts_tablet_manager.cc:1397] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250112 21:02:31.737488 23034 raft_consensus.cc:357] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.737592 23034 raft_consensus.cc:383] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.737622 23034 raft_consensus.cc:738] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.737623 23036 ts_tablet_manager.cc:1397] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.071s user 0.000s sys 0.002s
I20250112 21:02:31.737736 23034 consensus_queue.cc:260] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.737804 23037 tablet_bootstrap.cc:654] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.737994 23034 ts_tablet_manager.cc:1428] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.738036 23036 raft_consensus.cc:357] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.738143 23036 raft_consensus.cc:383] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.738179 23036 raft_consensus.cc:738] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.738186 23034 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.738323 23036 consensus_queue.cc:260] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.739285 23034 tablet_bootstrap.cc:654] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.739537 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 2 got 0
I20250112 21:02:31.740067 23036 ts_tablet_manager.cc:1428] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.740274 23036 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.741219 23036 tablet_bootstrap.cc:654] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.741566 23034 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.741643 23034 ts_tablet_manager.cc:1397] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250112 21:02:31.742038 23034 raft_consensus.cc:357] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.742138 23034 raft_consensus.cc:383] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.742170 23034 raft_consensus.cc:738] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.742298 23034 consensus_queue.cc:260] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.742573 23034 ts_tablet_manager.cc:1428] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.742740 23034 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.743084 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_296d3a5c48cf40b680dac989acdb4bb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.743451 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_296d3a5c48cf40b680dac989acdb4bb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.743608 23034 tablet_bootstrap.cc:654] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.744457 22461 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 2 got 0
I20250112 21:02:31.744493 23036 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.744568 23036 ts_tablet_manager.cc:1397] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20250112 21:02:31.744998 23036 raft_consensus.cc:357] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.745107 23036 raft_consensus.cc:383] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.745143 23036 raft_consensus.cc:738] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.745281 23034 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.745348 23034 ts_tablet_manager.cc:1397] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:31.745302 23036 consensus_queue.cc:260] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.745914 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_cc6da6fd869143d193e8b6edfd26b02f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.746249 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc6da6fd869143d193e8b6edfd26b02f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.745749 23034 raft_consensus.cc:357] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.747110 23034 raft_consensus.cc:383] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.747184 23034 raft_consensus.cc:738] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.747354 23034 consensus_queue.cc:260] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.748106 23034 ts_tablet_manager.cc:1428] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:31.748310 23034 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:31.748941 22582 consensus_peers.cc:487] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea -> Peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Couldn't send request to peer 3423673c659e4427958b13fc9eaa714d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2faf8cc5d3604e7ab814be894c842fc2. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.749164 23036 ts_tablet_manager.cc:1428] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:31.749837 23034 tablet_bootstrap.cc:654] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.752140 23036 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.752699 23037 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.752789 23037 ts_tablet_manager.cc:1397] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20250112 21:02:31.753248 23037 raft_consensus.cc:357] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.753358 23037 raft_consensus.cc:383] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.753393 23037 raft_consensus.cc:738] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.753485 23036 tablet_bootstrap.cc:654] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.753515 23037 consensus_queue.cc:260] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.753820 23037 ts_tablet_manager.cc:1428] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:31.754766 23037 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.756008 23037 tablet_bootstrap.cc:654] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.756999 23034 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.757143 23034 ts_tablet_manager.cc:1397] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20250112 21:02:31.757403 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]). Expected version 1 got 0
I20250112 21:02:31.757671 23034 raft_consensus.cc:357] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.757781 23034 raft_consensus.cc:383] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.757814 23034 raft_consensus.cc:738] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.757952 23034 consensus_queue.cc:260] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.758208 23034 ts_tablet_manager.cc:1428] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.758378 23034 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.759644 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]). Expected version 1 got 0
I20250112 21:02:31.759795 23034 tablet_bootstrap.cc:654] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.759935 22461 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]). Expected version 1 got 0
I20250112 21:02:31.756057 23038 ts_tablet_manager.cc:1918] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.760217 23038 log.cc:1198] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.761065 23038 ts_tablet_manager.cc:1939] T 3f292d9ff408488a84d432050ab317fc P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.762063 23040 tablet_replica.cc:331] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.762193 23040 raft_consensus.cc:2238] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.762297 23040 raft_consensus.cc:2267] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.762770 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 3f292d9ff408488a84d432050ab317fc (table default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]) successfully deleted
I20250112 21:02:31.762856 23037 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.762878 23040 ts_tablet_manager.cc:1905] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.762938 23037 ts_tablet_manager.cc:1397] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
W20250112 21:02:31.763200 22452 catalog_manager.cc:4839] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 04616ed61b134e889503c3b336ad4054 because the tablet was not found. No further retry: Not found: Tablet not found: 04616ed61b134e889503c3b336ad4054
I20250112 21:02:31.763413 23037 raft_consensus.cc:357] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.763514 23037 raft_consensus.cc:383] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.763545 23037 raft_consensus.cc:738] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.763643 23037 consensus_queue.cc:260] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.763860 23037 ts_tablet_manager.cc:1428] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.764029 23037 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.764905 23037 tablet_bootstrap.cc:654] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.766027 23040 ts_tablet_manager.cc:1918] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.766148 23040 log.cc:1198] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/1e2e8bde44bc453fa202d8c81356ad3b
I20250112 21:02:31.766409 23040 ts_tablet_manager.cc:1939] T 1e2e8bde44bc453fa202d8c81356ad3b P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.767040 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 1e2e8bde44bc453fa202d8c81356ad3b (table default.Table_197cf0808f644f2aac394ec59f82d263 [id=502d8e732d40440a92553df69e23e5a2]) successfully deleted
W20250112 21:02:31.767326 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet f0aad32a4d5f40c69b28219f0cc42538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0aad32a4d5f40c69b28219f0cc42538 already in progress: creating tablet
W20250112 21:02:31.767623 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet dfdbdb92c2f5441796e20643a5e02a80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfdbdb92c2f5441796e20643a5e02a80 already in progress: creating tablet
I20250112 21:02:31.767658 23040 tablet_replica.cc:331] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.767876 23040 raft_consensus.cc:2238] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.768167 23040 pending_rounds.cc:62] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Trying to abort 1 pending ops.
I20250112 21:02:31.768257 23040 pending_rounds.cc:69] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7113587717018767360 op_type: NO_OP noop_request { }
I20250112 21:02:31.768378 23040 raft_consensus.cc:2883] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250112 21:02:31.768584 23040 raft_consensus.cc:2267] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.768815 23082 raft_consensus.cc:491] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.768909 23082 raft_consensus.cc:513] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.769136 23040 ts_tablet_manager.cc:1905] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.769273 23082 leader_election.cc:290] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:31.769542 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43b4420df3e84c1888043baa9f2dd692" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:31.769876 22715 leader_election.cc:343] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.770519 23034 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.770603 23034 ts_tablet_manager.cc:1397] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250112 21:02:31.771011 23040 ts_tablet_manager.cc:1918] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:31.771070 23040 log.cc:1198] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/2faf8cc5d3604e7ab814be894c842fc2
I20250112 21:02:31.771040 23034 raft_consensus.cc:357] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.771133 23034 raft_consensus.cc:383] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.771162 23034 raft_consensus.cc:738] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.771277 23034 consensus_queue.cc:260] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.771353 23040 ts_tablet_manager.cc:1939] T 2faf8cc5d3604e7ab814be894c842fc2 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.771386 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43b4420df3e84c1888043baa9f2dd692" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.771545 23034 ts_tablet_manager.cc:1428] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.771725 23034 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.772593 23040 tablet_replica.cc:331] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
W20250112 21:02:31.772846 22717 leader_election.cc:343] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.772876 23040 raft_consensus.cc:2238] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.772919 22717 leader_election.cc:304] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.773051 23034 tablet_bootstrap.cc:654] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.773062 23040 raft_consensus.cc:2267] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.773262 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 2faf8cc5d3604e7ab814be894c842fc2 (table default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]) successfully deleted
I20250112 21:02:31.773697 23082 raft_consensus.cc:2743] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.774382 23037 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.774472 23037 ts_tablet_manager.cc:1397] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:31.774885 23037 raft_consensus.cc:357] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.774981 23037 raft_consensus.cc:383] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.775008 23037 raft_consensus.cc:738] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.775240 23037 consensus_queue.cc:260] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.775581 23037 ts_tablet_manager.cc:1428] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.775656 23040 ts_tablet_manager.cc:1905] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.775833 23037 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.776902 23037 tablet_bootstrap.cc:654] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.777041 23036 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.777135 23036 ts_tablet_manager.cc:1397] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20250112 21:02:31.777608 23036 raft_consensus.cc:357] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.777720 23036 raft_consensus.cc:383] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.777756 23036 raft_consensus.cc:738] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.777881 23037 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.777880 23036 consensus_queue.cc:260] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.777962 23082 raft_consensus.cc:491] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.778060 23037 ts_tablet_manager.cc:1397] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:31.778033 23082 raft_consensus.cc:513] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.778168 23036 ts_tablet_manager.cc:1428] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.778347 23036 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.778381 23082 leader_election.cc:290] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.778748 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40002b2a71741d9833974adc89e0c4e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.778852 22646 raft_consensus.cc:2463] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.779115 22715 leader_election.cc:304] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.779263 23082 raft_consensus.cc:2798] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.779309 23082 raft_consensus.cc:491] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.779342 23082 raft_consensus.cc:3054] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.779379 23036 tablet_bootstrap.cc:654] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.780265 23037 raft_consensus.cc:357] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.780295 23082 raft_consensus.cc:513] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.780637 23082 leader_election.cc:290] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.781062 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40002b2a71741d9833974adc89e0c4e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.781582 23034 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.781653 23034 ts_tablet_manager.cc:1397] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:31.782047 23034 raft_consensus.cc:357] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.782136 23034 raft_consensus.cc:383] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.782163 23034 raft_consensus.cc:738] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.782263 23034 consensus_queue.cc:260] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.782549 23034 ts_tablet_manager.cc:1428] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.782720 23034 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.782940 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 78e83f9dc722400bbbd3114156318ac4 (DEFAULT_TABLE table=default.Table_cc6da6fd869143d193e8b6edfd26b02f [id=e11d97b1eb5142f3a0d4f845c6285424]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.783190 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e83f9dc722400bbbd3114156318ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.783602 23034 tablet_bootstrap.cc:654] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.784006 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 78e83f9dc722400bbbd3114156318ac4 (DEFAULT_TABLE table=default.Table_cc6da6fd869143d193e8b6edfd26b02f [id=e11d97b1eb5142f3a0d4f845c6285424]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.784251 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e83f9dc722400bbbd3114156318ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.784809 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40002b2a71741d9833974adc89e0c4e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:31.784914 22717 leader_election.cc:343] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:31.785130 22717 leader_election.cc:343] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.785283 22892 tablet_service.cc:1467] Processing CreateTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.785480 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a057bfc6f20435fb6b6d0dacff66136. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.788993 23082 raft_consensus.cc:491] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.789072 23082 raft_consensus.cc:513] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.789415 23082 leader_election.cc:290] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.789896 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.781006 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b40002b2a71741d9833974adc89e0c4e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.790107 23037 raft_consensus.cc:383] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.790148 22646 raft_consensus.cc:3054] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.790170 23037 raft_consensus.cc:738] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.790297 23037 consensus_queue.cc:260] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
W20250112 21:02:31.790324 22717 leader_election.cc:343] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.790936 22614 tablet_service.cc:1467] Processing CreateTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.791026 22646 raft_consensus.cc:2463] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.791157 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a057bfc6f20435fb6b6d0dacff66136. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.791287 22715 leader_election.cc:304] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.791347 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.782657 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 78e83f9dc722400bbbd3114156318ac4 (DEFAULT_TABLE table=default.Table_cc6da6fd869143d193e8b6edfd26b02f [id=e11d97b1eb5142f3a0d4f845c6285424]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.791561 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a057bfc6f20435fb6b6d0dacff66136. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.791610 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e83f9dc722400bbbd3114156318ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.793303 23082 raft_consensus.cc:2798] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.793385 23082 raft_consensus.cc:695] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.793483 22612 tablet_service.cc:1467] Processing CreateTablet for tablet df5959512e2f4b23a8c275653cbce77c (DEFAULT_TABLE table=default.Table_85a014a4190e4ea684afc43dd0349122 [id=c85cd6a40e054c72aa6f50265504d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.793509 23082 consensus_queue.cc:237] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.793675 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5959512e2f4b23a8c275653cbce77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.784596 23040 ts_tablet_manager.cc:1918] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.793763 23040 log.cc:1198] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/159ed04aaf0447ad9b016d39f3271aaf
I20250112 21:02:31.794009 23040 ts_tablet_manager.cc:1939] T 159ed04aaf0447ad9b016d39f3271aaf P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.794405 23036 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.794468 23036 ts_tablet_manager.cc:1397] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250112 21:02:31.789803 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:31.794911 22715 leader_election.cc:343] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.794880 23036 raft_consensus.cc:357] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.794971 23036 raft_consensus.cc:383] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.794973 22715 leader_election.cc:304] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.795007 23036 raft_consensus.cc:738] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.795106 23065 raft_consensus.cc:2743] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.795106 23036 consensus_queue.cc:260] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.795353 23036 ts_tablet_manager.cc:1428] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.795535 23036 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.796336 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 416a58323f314344a297decdcc2f70df (DEFAULT_TABLE table=default.Table_296d3a5c48cf40b680dac989acdb4bb8 [id=0ba06cc71b614bc0b422d920fe4fe5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.796514 23036 tablet_bootstrap.cc:654] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.796557 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a58323f314344a297decdcc2f70df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.797008 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 416a58323f314344a297decdcc2f70df (DEFAULT_TABLE table=default.Table_296d3a5c48cf40b680dac989acdb4bb8 [id=0ba06cc71b614bc0b422d920fe4fe5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.797210 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a58323f314344a297decdcc2f70df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.795548 22892 tablet_service.cc:1467] Processing CreateTablet for tablet df5959512e2f4b23a8c275653cbce77c (DEFAULT_TABLE table=default.Table_85a014a4190e4ea684afc43dd0349122 [id=c85cd6a40e054c72aa6f50265504d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.798434 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5959512e2f4b23a8c275653cbce77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.798861 22458 catalog_manager.cc:5526] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:31.799057 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]). Expected version 1 got 0
I20250112 21:02:31.800459 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 416a58323f314344a297decdcc2f70df (DEFAULT_TABLE table=default.Table_296d3a5c48cf40b680dac989acdb4bb8 [id=0ba06cc71b614bc0b422d920fe4fe5a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.800661 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416a58323f314344a297decdcc2f70df. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.802456 23036 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.802443 22756 tablet_service.cc:1467] Processing CreateTablet for tablet df5959512e2f4b23a8c275653cbce77c (DEFAULT_TABLE table=default.Table_85a014a4190e4ea684afc43dd0349122 [id=c85cd6a40e054c72aa6f50265504d58c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.802542 23036 ts_tablet_manager.cc:1397] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250112 21:02:31.802659 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5959512e2f4b23a8c275653cbce77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.802973 23036 raft_consensus.cc:357] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.803062 23036 raft_consensus.cc:383] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.803089 23036 raft_consensus.cc:738] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.803190 23036 consensus_queue.cc:260] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.803431 23036 ts_tablet_manager.cc:1428] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:31.803495 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e5515bf0f1f5419d9af6b3d82fa33e7e (table default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]). Expected version 4 got 0
I20250112 21:02:31.803606 23036 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.804630 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.805001 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79963c1d3d8e45e9b94908efd6487cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.805660 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.805902 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79963c1d3d8e45e9b94908efd6487cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.808029 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.808485 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e5515bf0f1f5419d9af6b3d82fa33e7e (table default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]). Expected version 4 got 0
I20250112 21:02:31.808763 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79963c1d3d8e45e9b94908efd6487cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.809599 22627 tablet_service.cc:1467] Processing CreateTablet for tablet f944f0d5e5994fd5abb2ed2c991a3eef (DEFAULT_TABLE table=default.Table_0777a5d7db50457e90b14bcbccd77c8b [id=8d3d77cffd6f402895fceae55e6829bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.809999 23036 tablet_bootstrap.cc:654] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.810398 22892 tablet_service.cc:1467] Processing CreateTablet for tablet f944f0d5e5994fd5abb2ed2c991a3eef (DEFAULT_TABLE table=default.Table_0777a5d7db50457e90b14bcbccd77c8b [id=8d3d77cffd6f402895fceae55e6829bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.810683 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944f0d5e5994fd5abb2ed2c991a3eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.816442 23322 raft_consensus.cc:491] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a8456e9572be47fabce002f001805c33)
I20250112 21:02:31.816578 23322 raft_consensus.cc:513] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } }
I20250112 21:02:31.817941 23413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8456e9572be47fabce002f001805c33. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:31.818008 23322 leader_election.cc:290] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 466a54ef09a44559a1a0ee7c76bdf4c8 (127.21.194.253:36663), a8456e9572be47fabce002f001805c33 (127.21.194.252:40219)
I20250112 21:02:31.818120 23322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:31.818192 23322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:31.818034 23413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [sys.catalog]: This master's current role is: FOLLOWER
I20250112 21:02:31.819448 22403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 3 candidate_status { last_received { term: 2 index: 224 } } ignore_live_leader: false dest_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" is_pre_election: true
I20250112 21:02:31.819644 22475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "81853a8db6f14748910205ef23843fa0" candidate_term: 3 candidate_status { last_received { term: 2 index: 224 } } ignore_live_leader: false dest_uuid: "a8456e9572be47fabce002f001805c33" is_pre_election: true
I20250112 21:02:31.820284 23239 leader_election.cc:304] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81853a8db6f14748910205ef23843fa0; no voters: 466a54ef09a44559a1a0ee7c76bdf4c8, a8456e9572be47fabce002f001805c33
I20250112 21:02:31.820766 23413 raft_consensus.cc:2743] T 00000000000000000000000000000000 P 81853a8db6f14748910205ef23843fa0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250112 21:02:31.823278 23036 tablet_bootstrap.cc:492] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:31.823356 23036 ts_tablet_manager.cc:1397] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20250112 21:02:31.824003 23036 raft_consensus.cc:357] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.824146 23036 raft_consensus.cc:383] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.824214 23036 raft_consensus.cc:738] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.824393 23036 consensus_queue.cc:260] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.824608 23037 ts_tablet_manager.cc:1428] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.046s user 0.001s sys 0.000s
I20250112 21:02:31.825203 23037 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.827158 23037 tablet_bootstrap.cc:654] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.828675 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944f0d5e5994fd5abb2ed2c991a3eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.829773 23036 ts_tablet_manager.cc:1428] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20250112 21:02:31.830485 22884 tablet_service.cc:1514] Processing DeleteTablet for tablet a29dbc7d2a6f4ab2b645958e69665d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.830979 23038 tablet_replica.cc:331] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.831089 23038 raft_consensus.cc:2238] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.831178 23038 raft_consensus.cc:2267] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.832270 23036 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:31.834755 23036 tablet_bootstrap.cc:654] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.834837 22756 tablet_service.cc:1467] Processing CreateTablet for tablet f944f0d5e5994fd5abb2ed2c991a3eef (DEFAULT_TABLE table=default.Table_0777a5d7db50457e90b14bcbccd77c8b [id=8d3d77cffd6f402895fceae55e6829bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.835073 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944f0d5e5994fd5abb2ed2c991a3eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.835695 22762 tablet_service.cc:1467] Processing CreateTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.835915 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b088a5d5eb423e87d1542eaded5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.836195 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 580ef2d69119418c9f4479b024491497 (DEFAULT_TABLE table=default.Table_1598432ed2274fe2b9d2ab0c1867100d [id=4a0fa254b3584de09a295e08b1b56127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.836419 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580ef2d69119418c9f4479b024491497. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.837997 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_334064033b144ee1af033570e8132ce6" } new_table_name: "default.Table_19a92ad89b0b4e24984ba4442cda25f5" modify_external_catalogs: true
I20250112 21:02:31.840163 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 580ef2d69119418c9f4479b024491497 (DEFAULT_TABLE table=default.Table_1598432ed2274fe2b9d2ab0c1867100d [id=4a0fa254b3584de09a295e08b1b56127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.840417 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580ef2d69119418c9f4479b024491497. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.840616 22882 tablet_service.cc:1467] Processing CreateTablet for tablet 0c50b95d782e420a8e32acf58f95d85a (DEFAULT_TABLE table=default.Table_97936dd45d9b496cbbd47d899dfa6433 [id=2bf2e96a3eb84993826a17d1616421b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.840818 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c50b95d782e420a8e32acf58f95d85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.841396 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 0c50b95d782e420a8e32acf58f95d85a (DEFAULT_TABLE table=default.Table_97936dd45d9b496cbbd47d899dfa6433 [id=2bf2e96a3eb84993826a17d1616421b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.841578 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c50b95d782e420a8e32acf58f95d85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.842268 22458 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf" } modify_external_catalogs: true
I20250112 21:02:31.842378 22458 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf" } modify_external_catalogs: true
I20250112 21:02:31.842630 22884 tablet_service.cc:1467] Processing CreateTablet for tablet 580ef2d69119418c9f4479b024491497 (DEFAULT_TABLE table=default.Table_1598432ed2274fe2b9d2ab0c1867100d [id=4a0fa254b3584de09a295e08b1b56127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.842811 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580ef2d69119418c9f4479b024491497. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:31.846659 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55779970251c4f819e1e3405de0bc30b consensus state has no leader
I20250112 21:02:31.846794 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet 71c22a901e6c4348a9b0e79598a93cae from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.847796 22647 raft_consensus.cc:1270] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250112 21:02:31.847863 22717 consensus_peers.cc:487] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df -> Peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Couldn't send request to peer 3423673c659e4427958b13fc9eaa714d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.847900 22614 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6369517eed414295e2b23769bb5cf6 (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.848098 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6369517eed414295e2b23769bb5cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.848204 23082 consensus_queue.cc:1035] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.850389 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 0c50b95d782e420a8e32acf58f95d85a (DEFAULT_TABLE table=default.Table_97936dd45d9b496cbbd47d899dfa6433 [id=2bf2e96a3eb84993826a17d1616421b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.850554 23135 raft_consensus.cc:491] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.850633 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c50b95d782e420a8e32acf58f95d85a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.850643 23135 raft_consensus.cc:513] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.851207 23135 leader_election.cc:290] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.851514 23118 raft_consensus.cc:491] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.851584 23118 raft_consensus.cc:513] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.851898 23118 leader_election.cc:290] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
W20250112 21:02:31.852488 22582 leader_election.cc:343] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: 3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.852478 22461 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c3f61b92787e402a9c6c937605d353cb" } modify_external_catalogs: true
I20250112 21:02:31.852581 22461 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c3f61b92787e402a9c6c937605d353cb" } modify_external_catalogs: true
I20250112 21:02:31.856936 22612 tablet_service.cc:1467] Processing CreateTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.857169 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b088a5d5eb423e87d1542eaded5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.859162 22888 tablet_service.cc:1467] Processing CreateTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.859656 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b088a5d5eb423e87d1542eaded5cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.860523 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "458bbc607af0400d93fe7990999d90b9" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:31.860661 22781 raft_consensus.cc:2463] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:31.860775 23156 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a8456e9572be47fabce002f001805c33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81853a8db6f14748910205ef23843fa0" member_type: VOTER last_known_addr { host: "127.21.194.254" port: 46215 } } peers { permanent_uuid: "466a54ef09a44559a1a0ee7c76bdf4c8" member_type: VOTER last_known_addr { host: "127.21.194.253" port: 36663 } } peers { permanent_uuid: "a8456e9572be47fabce002f001805c33" member_type: VOTER last_known_addr { host: "127.21.194.252" port: 40219 } } }
I20250112 21:02:31.860901 23156 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33 [sys.catalog]: This master's current role is: LEADER
I20250112 21:02:31.861479 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_44a18784001e45b3a8c92835db52640c" } modify_external_catalogs: true
I20250112 21:02:31.861512 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_85a014a4190e4ea684afc43dd0349122" } modify_external_catalogs: true
I20250112 21:02:31.861573 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_44a18784001e45b3a8c92835db52640c" } modify_external_catalogs: true
I20250112 21:02:31.861605 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_85a014a4190e4ea684afc43dd0349122" } modify_external_catalogs: true
I20250112 21:02:31.861976 23040 tablet_replica.cc:331] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.862100 23040 raft_consensus.cc:2238] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.862196 23040 raft_consensus.cc:2267] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.863320 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "458bbc607af0400d93fe7990999d90b9" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.863667 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6369517eed414295e2b23769bb5cf6 (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.863922 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6369517eed414295e2b23769bb5cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.864814 23040 ts_tablet_manager.cc:1905] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.865422 23038 ts_tablet_manager.cc:1905] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.865955 22457 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0e82eb25c2fc428c8e093ecb164f72f0" } modify_external_catalogs: true
I20250112 21:02:31.866058 22457 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0e82eb25c2fc428c8e093ecb164f72f0" } modify_external_catalogs: true
W20250112 21:02:31.866043 22851 leader_election.cc:343] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.867440 23038 ts_tablet_manager.cc:1918] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.867512 23038 log.cc:1198] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/a29dbc7d2a6f4ab2b645958e69665d8d
I20250112 21:02:31.867707 23038 ts_tablet_manager.cc:1939] T a29dbc7d2a6f4ab2b645958e69665d8d P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.868549 22619 tablet_service.cc:1467] Processing CreateTablet for tablet 55779970251c4f819e1e3405de0bc30b (DEFAULT_TABLE table=default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.868579 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 55779970251c4f819e1e3405de0bc30b (DEFAULT_TABLE table=default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.868598 22758 tablet_service.cc:1467] Processing CreateTablet for tablet bd52409ed391433491b65bb00d33b36a (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.868786 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55779970251c4f819e1e3405de0bc30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.868993 22851 leader_election.cc:304] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.869196 23046 raft_consensus.cc:491] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.869266 23046 raft_consensus.cc:513] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.869544 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 71c22a901e6c4348a9b0e79598a93cae
I20250112 21:02:31.869606 23046 leader_election.cc:290] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.869680 23046 raft_consensus.cc:2798] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.869715 23046 raft_consensus.cc:491] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.869750 23046 raft_consensus.cc:3054] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.869804 22462 catalog_manager.cc:6596] ReplaceTablet: tablet 71c22a901e6c4348a9b0e79598a93cae deleted and replaced by tablet 780991d6673a4987a450413a808d2026
I20250112 21:02:31.870508 23046 raft_consensus.cc:513] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.870787 23046 leader_election.cc:290] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:31.870757 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 81f17a824b8c42ee8d7677e78ba77f9f (DEFAULT_TABLE table=default.Table_2184cbe9f8a041edb513e7c827672a4f [id=158b7dd0d4a94e4eae6d2e043137887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.870941 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd52409ed391433491b65bb00d33b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.871191 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 159ed04aaf0447ad9b016d39f3271aaf (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:31.871418 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f17a824b8c42ee8d7677e78ba77f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.872598 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 341765719b0d42168aafad19e5b4cc61 (DEFAULT_TABLE table=default.Table_7a1433e05e434f459f40014712bafb56 [id=46d3a709ca814fe28ab11c14def42e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.872786 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341765719b0d42168aafad19e5b4cc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.873327 22755 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3f9cdd5b59474f953fa0099553262f (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.873520 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f9cdd5b59474f953fa0099553262f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.874608 22616 tablet_service.cc:1467] Processing CreateTablet for tablet 6d727069e2614af5a7d1d40a6035b2e8 (DEFAULT_TABLE table=default.Table_8144da4b814841939a715b4ffe42117a [id=49c5d4af135743bf9883af3ace89ce22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.874938 22617 tablet_service.cc:1467] Processing CreateTablet for tablet 341765719b0d42168aafad19e5b4cc61 (DEFAULT_TABLE table=default.Table_7a1433e05e434f459f40014712bafb56 [id=46d3a709ca814fe28ab11c14def42e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.875316 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 75c0861ef2f741faa4ad04f0da4635e3 (DEFAULT_TABLE table=default.Table_f4a783bd63d14dfbbe32dbb16f30aa9d [id=b78e732dd0c149f6b22df587e072878a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.875568 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3f9cdd5b59474f953fa0099553262f (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.875718 22613 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c22a901e6c4348a9b0e79598a93cae with delete_type TABLET_DATA_DELETED (replaced by tablet 780991d6673a4987a450413a808d2026) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.876353 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 75c0861ef2f741faa4ad04f0da4635e3 (DEFAULT_TABLE table=default.Table_f4a783bd63d14dfbbe32dbb16f30aa9d [id=b78e732dd0c149f6b22df587e072878a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.876506 22753 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c22a901e6c4348a9b0e79598a93cae with delete_type TABLET_DATA_DELETED (replaced by tablet 780991d6673a4987a450413a808d2026) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.876586 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c0861ef2f741faa4ad04f0da4635e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.876653 23039 tablet_replica.cc:331] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.876730 22754 tablet_service.cc:1467] Processing CreateTablet for tablet 6d727069e2614af5a7d1d40a6035b2e8 (DEFAULT_TABLE table=default.Table_8144da4b814841939a715b4ffe42117a [id=49c5d4af135743bf9883af3ace89ce22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.876761 23039 raft_consensus.cc:2238] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.876895 23039 raft_consensus.cc:2267] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.876930 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d727069e2614af5a7d1d40a6035b2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.877920 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_46d079a6fdc1439ebf5ecc1e5852e534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.878294 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46d079a6fdc1439ebf5ecc1e5852e534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.878526 23039 ts_tablet_manager.cc:1905] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.878684 22619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55779970251c4f819e1e3405de0bc30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.879009 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d727069e2614af5a7d1d40a6035b2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.879271 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341765719b0d42168aafad19e5b4cc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.879714 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_c4e1eebe3d744f8fa524536c429323c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.879904 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c73dce51147e29837df3b364af790" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
W20250112 21:02:31.880012 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4e1eebe3d744f8fa524536c429323c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.880151 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c73dce51147e29837df3b364af790" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.880366 23039 ts_tablet_manager.cc:1918] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.880450 23039 log.cc:1198] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/71c22a901e6c4348a9b0e79598a93cae
W20250112 21:02:31.880618 22851 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.880672 23039 ts_tablet_manager.cc:1939] T 71c22a901e6c4348a9b0e79598a93cae P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
W20250112 21:02:31.880738 22851 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.880775 22851 leader_election.cc:304] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.880789 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_45334d393f0e40f7bdccaf6a555c37c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.881006 23135 raft_consensus.cc:2743] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250112 21:02:31.881064 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45334d393f0e40f7bdccaf6a555c37c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.881242 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f9cdd5b59474f953fa0099553262f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.881520 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c0861ef2f741faa4ad04f0da4635e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.881750 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "458bbc607af0400d93fe7990999d90b9" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.882019 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_542984b3a25740a29bde2dc4d076eb4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.882273 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_542984b3a25740a29bde2dc4d076eb4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.882920 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "458bbc607af0400d93fe7990999d90b9" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:31.883016 22782 raft_consensus.cc:3054] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.883519 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]) successfully deleted
I20250112 21:02:31.883810 22782 raft_consensus.cc:2463] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:31.883949 23082 raft_consensus.cc:491] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.884006 23082 raft_consensus.cc:513] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.884346 23082 leader_election.cc:290] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:31.884510 22851 leader_election.cc:343] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.884593 23040 ts_tablet_manager.cc:1918] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.884649 23040 log.cc:1198] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/a29dbc7d2a6f4ab2b645958e69665d8d
I20250112 21:02:31.884838 23040 ts_tablet_manager.cc:1939] T a29dbc7d2a6f4ab2b645958e69665d8d P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.884799 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cbead1e7a04ee58645c8a03fbfd71e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:31.885133 22717 leader_election.cc:343] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.885346 23040 tablet_replica.cc:331] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.885383 22614 tablet_service.cc:1467] Processing CreateTablet for tablet 81f17a824b8c42ee8d7677e78ba77f9f (DEFAULT_TABLE table=default.Table_2184cbe9f8a041edb513e7c827672a4f [id=158b7dd0d4a94e4eae6d2e043137887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.885475 23040 raft_consensus.cc:2238] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.885566 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f17a824b8c42ee8d7677e78ba77f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.885579 23040 raft_consensus.cc:2267] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.886094 23040 ts_tablet_manager.cc:1905] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.886519 22851 leader_election.cc:304] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:31.886736 23135 raft_consensus.cc:2798] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.886814 23135 raft_consensus.cc:695] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:31.886933 23135 consensus_queue.cc:237] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.888598 23040 ts_tablet_manager.cc:1918] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.888665 23040 log.cc:1198] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/bdeb12d12d3244dbac58127ebeb662cd
I20250112 21:02:31.888729 23406 tablet.cc:1721] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.888873 23040 ts_tablet_manager.cc:1939] T bdeb12d12d3244dbac58127ebeb662cd P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.889328 23040 tablet_replica.cc:331] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.889431 23040 raft_consensus.cc:2238] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.889518 23040 raft_consensus.cc:2267] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.892307 22627 tablet_service.cc:1467] Processing CreateTablet for tablet bd52409ed391433491b65bb00d33b36a (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.892529 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd52409ed391433491b65bb00d33b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.895467 23037 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.895538 23037 ts_tablet_manager.cc:1397] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.000s
I20250112 21:02:31.896133 23034 tablet_bootstrap.cc:492] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.896209 23034 ts_tablet_manager.cc:1397] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.000s
I20250112 21:02:31.896621 23037 raft_consensus.cc:357] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.896715 23037 raft_consensus.cc:383] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.896672 23034 raft_consensus.cc:357] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.896744 23037 raft_consensus.cc:738] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.896755 23034 raft_consensus.cc:383] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.896785 23034 raft_consensus.cc:738] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.896848 23037 consensus_queue.cc:260] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.896875 23034 consensus_queue.cc:260] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.897130 23034 ts_tablet_manager.cc:1428] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.897128 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7486a9a641437fa13470ff586d3567 (DEFAULT_TABLE table=default.Table_0e82eb25c2fc428c8e093ecb164f72f0 [id=e7243aa0d6654d7c875a684a76d3f51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.897348 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7486a9a641437fa13470ff586d3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.897565 23040 ts_tablet_manager.cc:1905] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.897976 23037 ts_tablet_manager.cc:1428] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.899310 23040 ts_tablet_manager.cc:1918] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.899376 23040 log.cc:1198] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/0ce0379839924289921a2f75c986953a
I20250112 21:02:31.899626 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3f9cdd5b59474f953fa0099553262f (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.899772 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 75c0861ef2f741faa4ad04f0da4635e3 (DEFAULT_TABLE table=default.Table_f4a783bd63d14dfbbe32dbb16f30aa9d [id=b78e732dd0c149f6b22df587e072878a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.899860 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3f9cdd5b59474f953fa0099553262f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.899959 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c0861ef2f741faa4ad04f0da4635e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.900307 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 6d727069e2614af5a7d1d40a6035b2e8 (DEFAULT_TABLE table=default.Table_8144da4b814841939a715b4ffe42117a [id=49c5d4af135743bf9883af3ace89ce22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.900487 22886 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c22a901e6c4348a9b0e79598a93cae with delete_type TABLET_DATA_DELETED (replaced by tablet 780991d6673a4987a450413a808d2026) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.900700 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d727069e2614af5a7d1d40a6035b2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.899636 22883 tablet_service.cc:1467] Processing CreateTablet for tablet 55779970251c4f819e1e3405de0bc30b (DEFAULT_TABLE table=default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.901767 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 341765719b0d42168aafad19e5b4cc61 (DEFAULT_TABLE table=default.Table_7a1433e05e434f459f40014712bafb56 [id=46d3a709ca814fe28ab11c14def42e2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.901925 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55779970251c4f819e1e3405de0bc30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.902068 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341765719b0d42168aafad19e5b4cc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.902868 22458 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:31.903362 23038 tablet_replica.cc:331] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.903476 23038 raft_consensus.cc:2238] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.903596 23038 raft_consensus.cc:2267] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:31.903628 22580 leader_election.cc:343] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.903690 22580 leader_election.cc:304] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.903919 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_b8d66a96310443e19fe60081f030c323"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.904138 23118 raft_consensus.cc:2743] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:31.904197 23038 ts_tablet_manager.cc:1905] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:31.904248 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8d66a96310443e19fe60081f030c323 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.902868 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet a29dbc7d2a6f4ab2b645958e69665d8d (table default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]) successfully deleted
I20250112 21:02:31.906175 23038 ts_tablet_manager.cc:1918] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.906230 23038 log.cc:1198] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/71c22a901e6c4348a9b0e79598a93cae
I20250112 21:02:31.906430 23038 ts_tablet_manager.cc:1939] T 71c22a901e6c4348a9b0e79598a93cae P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.906716 23034 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.906960 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_e0bbe825854948e092e7cd7016a76e45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.907249 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0bbe825854948e092e7cd7016a76e45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.907701 23034 tablet_bootstrap.cc:654] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.907958 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7486a9a641437fa13470ff586d3567 (DEFAULT_TABLE table=default.Table_0e82eb25c2fc428c8e093ecb164f72f0 [id=e7243aa0d6654d7c875a684a76d3f51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.908041 22884 tablet_service.cc:1467] Processing CreateTablet for tablet bd52409ed391433491b65bb00d33b36a (DEFAULT_TABLE table=default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.908217 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet b40002b2a71741d9833974adc89e0c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.908259 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd52409ed391433491b65bb00d33b36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.908784 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]) successfully deleted
W20250112 21:02:31.909183 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet b40002b2a71741d9833974adc89e0c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b40002b2a71741d9833974adc89e0c4e already in progress: creating tablet
I20250112 21:02:31.909440 23040 ts_tablet_manager.cc:1939] T 0ce0379839924289921a2f75c986953a P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.910219 22882 tablet_service.cc:1467] Processing CreateTablet for tablet 81f17a824b8c42ee8d7677e78ba77f9f (DEFAULT_TABLE table=default.Table_2184cbe9f8a041edb513e7c827672a4f [id=158b7dd0d4a94e4eae6d2e043137887c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.910415 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81f17a824b8c42ee8d7677e78ba77f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.913113 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet a29dbc7d2a6f4ab2b645958e69665d8d (table default.Table_16f13034cb3a4c2baa025926c4add500 [id=aac4bac6b5434e6a9c9755d63bf0e7b2]) successfully deleted
I20250112 21:02:31.913223 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet bdeb12d12d3244dbac58127ebeb662cd (table default.Table_d73f9b21518a49e798e5dff732a78293 [id=75df653ef27a498a96a8725368b32a4b]) successfully deleted
I20250112 21:02:31.913300 23034 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.913378 23034 ts_tablet_manager.cc:1397] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250112 21:02:31.913805 23034 raft_consensus.cc:357] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.913914 23034 raft_consensus.cc:383] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.913949 23034 raft_consensus.cc:738] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.913882 22892 tablet_service.cc:1467] Processing CreateTablet for tablet 0b7486a9a641437fa13470ff586d3567 (DEFAULT_TABLE table=default.Table_0e82eb25c2fc428c8e093ecb164f72f0 [id=e7243aa0d6654d7c875a684a76d3f51c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.914059 23034 consensus_queue.cc:260] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.914085 22754 tablet_service.cc:1514] Processing DeleteTablet for tablet b40002b2a71741d9833974adc89e0c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.914304 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7486a9a641437fa13470ff586d3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.914328 23034 ts_tablet_manager.cc:1428] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.915635 23039 tablet_replica.cc:331] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.915755 23039 raft_consensus.cc:2238] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.915917 23039 raft_consensus.cc:2267] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.916136 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet b40002b2a71741d9833974adc89e0c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.916270 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet b40002b2a71741d9833974adc89e0c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.916659 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet df5959512e2f4b23a8c275653cbce77c
I20250112 21:02:31.916821 23354 tablet.cc:1721] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:31.917079 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b7486a9a641437fa13470ff586d3567. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.917207 23034 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.918150 23034 tablet_bootstrap.cc:654] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.918241 22460 catalog_manager.cc:5526] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:31.918419 22460 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_084d6398ba27408cad969d11e96ec80b [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 2 got 0
I20250112 21:02:31.918773 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cbead1e7a04ee58645c8a03fbfd71e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.918891 22646 raft_consensus.cc:2463] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.919113 23034 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.919181 23034 ts_tablet_manager.cc:1397] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:31.919168 22715 leader_election.cc:304] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.919406 23065 raft_consensus.cc:2798] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.919456 23065 raft_consensus.cc:491] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.919507 23065 raft_consensus.cc:3054] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.919631 23034 raft_consensus.cc:357] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.919716 23034 raft_consensus.cc:383] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.919746 23034 raft_consensus.cc:738] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.919840 23034 consensus_queue.cc:260] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.920084 23034 ts_tablet_manager.cc:1428] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.920258 23034 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.920275 23037 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:31.920315 23065 raft_consensus.cc:513] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.920655 23065 leader_election.cc:290] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.921187 23037 tablet_bootstrap.cc:654] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.921291 23034 tablet_bootstrap.cc:654] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.921473 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cbead1e7a04ee58645c8a03fbfd71e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.921566 22646 raft_consensus.cc:3054] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.922354 23034 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.922418 23034 ts_tablet_manager.cc:1397] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:31.922425 22646 raft_consensus.cc:2463] T 92cbead1e7a04ee58645c8a03fbfd71e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.922712 22715 leader_election.cc:304] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:31.922808 23034 raft_consensus.cc:357] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.922911 23034 raft_consensus.cc:383] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.922946 23034 raft_consensus.cc:738] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.923043 23034 consensus_queue.cc:260] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.923276 23034 ts_tablet_manager.cc:1428] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.923419 23034 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.924269 23034 tablet_bootstrap.cc:654] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.922856 23082 raft_consensus.cc:2798] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.924897 23082 raft_consensus.cc:695] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.925026 23082 consensus_queue.cc:237] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.926182 23037 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:31.926259 23037 ts_tablet_manager.cc:1397] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250112 21:02:31.926713 23037 raft_consensus.cc:357] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.926802 23037 raft_consensus.cc:383] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.926836 23037 raft_consensus.cc:738] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.926968 23037 consensus_queue.cc:260] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.927352 23037 ts_tablet_manager.cc:1428] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.927816 23040 tablet_replica.cc:331] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.927928 23040 raft_consensus.cc:2238] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.928015 23040 raft_consensus.cc:2267] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.928124 23065 raft_consensus.cc:491] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.928201 23065 raft_consensus.cc:513] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.928718 23065 leader_election.cc:290] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.929253 23040 ts_tablet_manager.cc:1905] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.931309 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet d19c73dce51147e29837df3b364af790
I20250112 21:02:31.931326 23040 ts_tablet_manager.cc:1918] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.931385 23040 log.cc:1198] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/3f292d9ff408488a84d432050ab317fc
I20250112 21:02:31.927436 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92cbead1e7a04ee58645c8a03fbfd71e" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.931573 23040 ts_tablet_manager.cc:1939] T 3f292d9ff408488a84d432050ab317fc P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.929159 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cbf428b373d462ca89bd39795c6ed31" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:31.931929 22717 leader_election.cc:343] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.932067 23040 tablet_replica.cc:331] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
W20250112 21:02:31.932111 22717 leader_election.cc:343] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.932176 23040 raft_consensus.cc:2238] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.931231 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet df5959512e2f4b23a8c275653cbce77c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.932339 23040 raft_consensus.cc:2267] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.932498 23065 raft_consensus.cc:491] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:31.932560 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0b7486a9a641437fa13470ff586d3567
I20250112 21:02:31.932565 23065 raft_consensus.cc:513] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.922080 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6369517eed414295e2b23769bb5cf6 (DEFAULT_TABLE table=default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.932876 23065 leader_election.cc:290] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.932919 22457 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_b44cd661c42a45b480baa1ea160d909f" } new_table_name: "default.Table_8e24beac6ddf4937af42e19af45baf3f" modify_external_catalogs: true
I20250112 21:02:31.933089 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4e55df14b84ca9af9fb2ee73022bb8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:31.933202 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4e55df14b84ca9af9fb2ee73022bb8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.933305 22647 raft_consensus.cc:2463] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
W20250112 21:02:31.933391 22717 leader_election.cc:343] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.932794 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6369517eed414295e2b23769bb5cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.933554 22715 leader_election.cc:304] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.933740 23065 raft_consensus.cc:2798] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.933785 23065 raft_consensus.cc:491] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.933818 23065 raft_consensus.cc:3054] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.933792 22464 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_2ab7b7c9de6a4ef0af72a85800f3a067" } new_table_name: "default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1" modify_external_catalogs: true
I20250112 21:02:31.933766 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_7ffeb53161ed492e92b205fdbd6158af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.934073 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ffeb53161ed492e92b205fdbd6158af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.934545 22463 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ded0955d63e42d78453ee94a59d413d from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.934602 23065 raft_consensus.cc:513] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.934904 23065 leader_election.cc:290] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:31.935114 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4e55df14b84ca9af9fb2ee73022bb8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:31.935220 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d4e55df14b84ca9af9fb2ee73022bb8" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.935246 22459 master_service.cc:946] ReplaceTablet: received request to replace tablet 0db56f76b0b7473bb5d70463ec5b2484 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.935310 22647 raft_consensus.cc:3054] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:31.935422 22717 leader_election.cc:343] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.936013 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_8144da4b814841939a715b4ffe42117a" } new_table_name: "default.Table_2a59672c5c7940edbf6576966de19785" modify_external_catalogs: true
I20250112 21:02:31.936107 22647 raft_consensus.cc:2463] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.936371 22715 leader_election.cc:304] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.937055 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet f2b088a5d5eb423e87d1542eaded5cd7 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.937640 23065 raft_consensus.cc:2798] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.937716 23065 raft_consensus.cc:695] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.937835 23065 consensus_queue.cc:237] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
W20250112 21:02:31.938274 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet df5959512e2f4b23a8c275653cbce77c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5959512e2f4b23a8c275653cbce77c already in progress: creating tablet
I20250112 21:02:31.938583 23034 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.938653 23034 ts_tablet_manager.cc:1397] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20250112 21:02:31.938946 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_bfd32e031d4342b1934105b7a0241d72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:31.939096 23034 raft_consensus.cc:357] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.939180 23034 raft_consensus.cc:383] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.939220 23034 raft_consensus.cc:738] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.939254 23037 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
W20250112 21:02:31.939247 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfd32e031d4342b1934105b7a0241d72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.939327 23034 consensus_queue.cc:260] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.939585 23034 ts_tablet_manager.cc:1428] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.939739 23034 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.940150 23040 ts_tablet_manager.cc:1905] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.940693 23034 tablet_bootstrap.cc:654] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.940714 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cbf428b373d462ca89bd39795c6ed31" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.940816 22646 raft_consensus.cc:2463] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:31.941037 22715 leader_election.cc:304] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.941229 23082 raft_consensus.cc:2798] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:31.941274 23082 raft_consensus.cc:491] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:31.941310 23082 raft_consensus.cc:3054] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.942162 23082 raft_consensus.cc:513] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.942278 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7486a9a641437fa13470ff586d3567 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.942469 23082 leader_election.cc:290] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:31.942716 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 0b7486a9a641437fa13470ff586d3567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b7486a9a641437fa13470ff586d3567 already in progress: creating tablet
I20250112 21:02:31.942808 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet d19c73dce51147e29837df3b364af790 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.942896 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cbf428b373d462ca89bd39795c6ed31" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:31.942947 23038 tablet_replica.cc:331] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.942983 22646 raft_consensus.cc:3054] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:31.943070 23038 raft_consensus.cc:2238] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.943161 23038 raft_consensus.cc:2267] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.943804 22646 raft_consensus.cc:2463] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:31.942809 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cbf428b373d462ca89bd39795c6ed31" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:31.944324 22717 leader_election.cc:343] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:31.944495 22715 leader_election.cc:304] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters: 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:31.944677 23082 raft_consensus.cc:2798] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:31.944746 23082 raft_consensus.cc:695] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:31.944851 23082 consensus_queue.cc:237] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.945147 23038 ts_tablet_manager.cc:1905] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.945963 23039 ts_tablet_manager.cc:1905] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.947247 23038 ts_tablet_manager.cc:1918] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.947331 23038 log.cc:1198] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/d19c73dce51147e29837df3b364af790
I20250112 21:02:31.947549 23038 ts_tablet_manager.cc:1939] T d19c73dce51147e29837df3b364af790 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.947924 23039 ts_tablet_manager.cc:1918] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.947981 23039 log.cc:1198] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:31.948088 23040 ts_tablet_manager.cc:1918] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.948158 23040 log.cc:1198] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/71c22a901e6c4348a9b0e79598a93cae
I20250112 21:02:31.948172 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet d19c73dce51147e29837df3b364af790 (table default.Table_44a18784001e45b3a8c92835db52640c [id=412aa24e1d20476ab4b6bfaf07c72e22]) successfully deleted
I20250112 21:02:31.948379 23040 ts_tablet_manager.cc:1939] T 71c22a901e6c4348a9b0e79598a93cae P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.948446 23039 ts_tablet_manager.cc:1939] T b40002b2a71741d9833974adc89e0c4e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.948895 23040 tablet_replica.cc:331] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.948999 23040 raft_consensus.cc:2238] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.949105 23040 raft_consensus.cc:2267] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.949968 23037 tablet_bootstrap.cc:654] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.950233 23040 ts_tablet_manager.cc:1905] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.951848 23034 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.951928 23034 ts_tablet_manager.cc:1397] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250112 21:02:31.952181 23040 ts_tablet_manager.cc:1918] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.952186 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 0ce0379839924289921a2f75c986953a (table default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]) successfully deleted
I20250112 21:02:31.952250 23040 log.cc:1198] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:31.952304 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 3f292d9ff408488a84d432050ab317fc (table default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]) successfully deleted
I20250112 21:02:31.952461 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 71c22a901e6c4348a9b0e79598a93cae (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]) successfully deleted
I20250112 21:02:31.952502 23040 ts_tablet_manager.cc:1939] T b40002b2a71741d9833974adc89e0c4e P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.952502 23034 raft_consensus.cc:357] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.952584 23034 raft_consensus.cc:383] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.952615 23034 raft_consensus.cc:738] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.952654 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]) successfully deleted
I20250112 21:02:31.952749 23034 consensus_queue.cc:260] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.952920 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet df5959512e2f4b23a8c275653cbce77c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.953018 23034 ts_tablet_manager.cc:1428] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.953049 22754 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7486a9a641437fa13470ff586d3567 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.953181 23034 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.954054 23034 tablet_bootstrap.cc:654] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.954466 22616 tablet_service.cc:1514] Processing DeleteTablet for tablet df5959512e2f4b23a8c275653cbce77c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.954605 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet d19c73dce51147e29837df3b364af790 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.954715 22615 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b7486a9a641437fa13470ff586d3567 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.954826 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet d19c73dce51147e29837df3b364af790 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.959224 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet b40002b2a71741d9833974adc89e0c4e (table default.Table_2a0a3e7b5f664c0ebc40835cb0e07cbf [id=54cb1bc41617475294f6b87b15864901]) successfully deleted
W20250112 21:02:31.959285 22464 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c84208a885c54f6c8dfde6f91b1c938a consensus state has no leader
W20250112 21:02:31.959409 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet df5959512e2f4b23a8c275653cbce77c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5959512e2f4b23a8c275653cbce77c already in progress: creating tablet
W20250112 21:02:31.959504 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet d19c73dce51147e29837df3b364af790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d19c73dce51147e29837df3b364af790 already in progress: creating tablet
W20250112 21:02:31.959605 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 0b7486a9a641437fa13470ff586d3567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b7486a9a641437fa13470ff586d3567 already in progress: creating tablet
W20250112 21:02:31.959690 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet df5959512e2f4b23a8c275653cbce77c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df5959512e2f4b23a8c275653cbce77c already in progress: creating tablet
W20250112 21:02:31.960318 22466 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d727069e2614af5a7d1d40a6035b2e8 consensus state has no leader
I20250112 21:02:31.960588 22466 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_084d6398ba27408cad969d11e96ec80b" } new_table_name: "default.Table_4ef72badd3184cdc81f8e4e2062bbb45" modify_external_catalogs: true
I20250112 21:02:31.960954 22463 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 1ded0955d63e42d78453ee94a59d413d
I20250112 21:02:31.961191 22463 catalog_manager.cc:6596] ReplaceTablet: tablet 1ded0955d63e42d78453ee94a59d413d deleted and replaced by tablet ae4b956e0e7846e687d68ddefe2cd298
I20250112 21:02:31.961321 22463 master_service.cc:946] ReplaceTablet: received request to replace tablet e5515bf0f1f5419d9af6b3d82fa33e7e from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:31.961962 22459 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:31.962186 22459 catalog_manager.cc:6596] ReplaceTablet: tablet 0db56f76b0b7473bb5d70463ec5b2484 deleted and replaced by tablet b1363a0b11ec4a81b40fb9d78264191f
I20250112 21:02:31.962383 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8bb86fb98a78465bb1e5cd62ec692d8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.962687 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bb86fb98a78465bb1e5cd62ec692d8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.963358 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet f2b088a5d5eb423e87d1542eaded5cd7
I20250112 21:02:31.963584 22462 catalog_manager.cc:6596] ReplaceTablet: tablet f2b088a5d5eb423e87d1542eaded5cd7 deleted and replaced by tablet d2e37d9a5e9f4973b718f7aa14ca6ab3
I20250112 21:02:31.963759 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_f6da1e30a81d47ff8607a8fb3f1b8bb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:31.959775 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 0b7486a9a641437fa13470ff586d3567 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b7486a9a641437fa13470ff586d3567 already in progress: creating tablet
W20250112 21:02:31.963970 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet d19c73dce51147e29837df3b364af790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d19c73dce51147e29837df3b364af790 already in progress: creating tablet
W20250112 21:02:31.964030 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6da1e30a81d47ff8607a8fb3f1b8bb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:31.964428 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 287e9340b43a418791e5bcfe7e721720
I20250112 21:02:31.964455 22754 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 with delete_type TABLET_DATA_DELETED (replaced by tablet d2e37d9a5e9f4973b718f7aa14ca6ab3) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.964574 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 with delete_type TABLET_DATA_DELETED (replaced by tablet b1363a0b11ec4a81b40fb9d78264191f) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.964812 22627 tablet_service.cc:1514] Processing DeleteTablet for tablet 287e9340b43a418791e5bcfe7e721720 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.964864 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 with delete_type TABLET_DATA_DELETED (replaced by tablet b1363a0b11ec4a81b40fb9d78264191f) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.964814 22616 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 with delete_type TABLET_DATA_DELETED (replaced by tablet d2e37d9a5e9f4973b718f7aa14ca6ab3) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.965013 23040 tablet_replica.cc:331] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
W20250112 21:02:31.965085 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet f2b088a5d5eb423e87d1542eaded5cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b088a5d5eb423e87d1542eaded5cd7 already in progress: creating tablet
I20250112 21:02:31.965131 23040 raft_consensus.cc:2238] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:31.965260 23039 tablet_replica.cc:331] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.965260 22615 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ded0955d63e42d78453ee94a59d413d with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b956e0e7846e687d68ddefe2cd298) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.965313 23040 raft_consensus.cc:2267] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.965373 23039 raft_consensus.cc:2238] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.965461 23039 raft_consensus.cc:2267] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.965494 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ded0955d63e42d78453ee94a59d413d with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b956e0e7846e687d68ddefe2cd298) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.965766 23040 ts_tablet_manager.cc:1905] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.965965 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet 287e9340b43a418791e5bcfe7e721720 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:31.966112 23039 ts_tablet_manager.cc:1905] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.966398 22892 tablet_service.cc:1514] Processing DeleteTablet for tablet 0db56f76b0b7473bb5d70463ec5b2484 with delete_type TABLET_DATA_DELETED (replaced by tablet b1363a0b11ec4a81b40fb9d78264191f) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.966548 22897 tablet_service.cc:1514] Processing DeleteTablet for tablet f2b088a5d5eb423e87d1542eaded5cd7 with delete_type TABLET_DATA_DELETED (replaced by tablet d2e37d9a5e9f4973b718f7aa14ca6ab3) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.966657 22882 tablet_service.cc:1514] Processing DeleteTablet for tablet 287e9340b43a418791e5bcfe7e721720 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.966739 22888 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ded0955d63e42d78453ee94a59d413d with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b956e0e7846e687d68ddefe2cd298) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.968712 23040 ts_tablet_manager.cc:1918] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.968773 23040 log.cc:1198] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/287e9340b43a418791e5bcfe7e721720
I20250112 21:02:31.968991 23040 ts_tablet_manager.cc:1939] T 287e9340b43a418791e5bcfe7e721720 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.969228 23039 ts_tablet_manager.cc:1918] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.969326 23039 log.cc:1198] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:31.969596 23039 ts_tablet_manager.cc:1939] T 0db56f76b0b7473bb5d70463ec5b2484 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.969799 23040 tablet_replica.cc:331] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:31.969903 23040 raft_consensus.cc:2238] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.969985 23040 raft_consensus.cc:2267] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.970430 23040 ts_tablet_manager.cc:1905] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.970413 23039 tablet_replica.cc:331] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.970587 23039 raft_consensus.cc:2238] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.970719 23039 raft_consensus.cc:2267] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.971179 23039 ts_tablet_manager.cc:1905] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.971195 23034 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.971267 23034 ts_tablet_manager.cc:1397] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250112 21:02:31.971658 23034 raft_consensus.cc:357] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.971757 23034 raft_consensus.cc:383] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.971788 23034 raft_consensus.cc:738] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.971923 23034 consensus_queue.cc:260] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.972224 23034 ts_tablet_manager.cc:1428] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.972494 23034 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.972878 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0db56f76b0b7473bb5d70463ec5b2484 (table default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]) successfully deleted
I20250112 21:02:31.973069 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
W20250112 21:02:31.973183 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 0db56f76b0b7473bb5d70463ec5b2484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0db56f76b0b7473bb5d70463ec5b2484 already in progress: creating tablet
I20250112 21:02:31.973258 23038 tablet_replica.cc:331] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
W20250112 21:02:31.973340 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet f2b088a5d5eb423e87d1542eaded5cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b088a5d5eb423e87d1542eaded5cd7 already in progress: creating tablet
I20250112 21:02:31.973373 23038 raft_consensus.cc:2238] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.973500 23038 raft_consensus.cc:2267] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:31.973779 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 0db56f76b0b7473bb5d70463ec5b2484 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0db56f76b0b7473bb5d70463ec5b2484 already in progress: creating tablet
W20250112 21:02:31.973914 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet f2b088a5d5eb423e87d1542eaded5cd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2b088a5d5eb423e87d1542eaded5cd7 already in progress: creating tablet
I20250112 21:02:31.974149 23034 tablet_bootstrap.cc:654] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.974367 23038 ts_tablet_manager.cc:1905] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.975950 23039 ts_tablet_manager.cc:1918] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.976008 23039 log.cc:1198] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/1ded0955d63e42d78453ee94a59d413d
I20250112 21:02:31.976105 22463 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet e5515bf0f1f5419d9af6b3d82fa33e7e
I20250112 21:02:31.976375 22463 catalog_manager.cc:6596] ReplaceTablet: tablet e5515bf0f1f5419d9af6b3d82fa33e7e deleted and replaced by tablet e1854ec7cb6d47539bba1d44c49c8d99
I20250112 21:02:31.976389 23038 ts_tablet_manager.cc:1918] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.976477 23038 log.cc:1198] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/287e9340b43a418791e5bcfe7e721720
I20250112 21:02:31.976711 23038 ts_tablet_manager.cc:1939] T 287e9340b43a418791e5bcfe7e721720 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.977057 23040 ts_tablet_manager.cc:1918] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.977118 23040 log.cc:1198] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/1ded0955d63e42d78453ee94a59d413d
I20250112 21:02:31.977178 23039 ts_tablet_manager.cc:1939] T 1ded0955d63e42d78453ee94a59d413d P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.977293 23040 ts_tablet_manager.cc:1939] T 1ded0955d63e42d78453ee94a59d413d P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:31.977725 23039 tablet_replica.cc:331] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.977864 23039 raft_consensus.cc:2238] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.977991 23039 raft_consensus.cc:2267] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.978040 22882 tablet_service.cc:1514] Processing DeleteTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e with delete_type TABLET_DATA_DELETED (replaced by tablet e1854ec7cb6d47539bba1d44c49c8d99) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:31.978524 23039 ts_tablet_manager.cc:1905] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.979223 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 1ded0955d63e42d78453ee94a59d413d (table default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]) successfully deleted
I20250112 21:02:31.979264 22782 raft_consensus.cc:1270] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:31.979547 23038 tablet_replica.cc:331] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:31.979647 22615 tablet_service.cc:1514] Processing DeleteTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e with delete_type TABLET_DATA_DELETED (replaced by tablet e1854ec7cb6d47539bba1d44c49c8d99) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:31.979682 23038 raft_consensus.cc:2238] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.979766 23038 raft_consensus.cc:2267] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.979756 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
I20250112 21:02:31.979809 23135 consensus_queue.cc:1035] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:31.979908 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e with delete_type TABLET_DATA_DELETED (replaced by tablet e1854ec7cb6d47539bba1d44c49c8d99) from {username='slave'} at 127.0.0.1:44696
W20250112 21:02:31.980111 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 1ded0955d63e42d78453ee94a59d413d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ded0955d63e42d78453ee94a59d413d already in progress: creating tablet
W20250112 21:02:31.980530 22851 consensus_peers.cc:487] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d -> Peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Couldn't send request to peer d8faec3969b64c33a4bf9aba509785ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:31.980831 23038 ts_tablet_manager.cc:1905] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.980855 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 1ded0955d63e42d78453ee94a59d413d (table default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]) successfully deleted
W20250112 21:02:31.981258 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet e5515bf0f1f5419d9af6b3d82fa33e7e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5515bf0f1f5419d9af6b3d82fa33e7e already in progress: creating tablet
I20250112 21:02:31.982792 23038 ts_tablet_manager.cc:1918] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.982903 23038 log.cc:1198] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/e5515bf0f1f5419d9af6b3d82fa33e7e
I20250112 21:02:31.984103 23039 ts_tablet_manager.cc:1918] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250112 21:02:31.984166 23039 log.cc:1198] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/287e9340b43a418791e5bcfe7e721720
I20250112 21:02:31.984387 23039 ts_tablet_manager.cc:1939] T 287e9340b43a418791e5bcfe7e721720 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.985062 23039 tablet_replica.cc:331] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:31.985172 23039 raft_consensus.cc:2238] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:31.985289 23039 raft_consensus.cc:2267] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:31.986552 23034 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:31.986625 23034 ts_tablet_manager.cc:1397] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250112 21:02:31.987035 23034 raft_consensus.cc:357] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.987180 23034 raft_consensus.cc:383] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:31.987218 23034 raft_consensus.cc:738] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:31.987322 23034 consensus_queue.cc:260] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:31.987831 23034 ts_tablet_manager.cc:1428] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:31.988886 23034 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:31.989574 23406 tablet.cc:1721] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:31.991477 23034 tablet_bootstrap.cc:654] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:31.992486 23039 ts_tablet_manager.cc:1905] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:31.994575 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 780991d6673a4987a450413a808d2026 (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.994841 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780991d6673a4987a450413a808d2026. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.996867 23039 ts_tablet_manager.cc:1918] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:31.997002 23039 log.cc:1198] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/e5515bf0f1f5419d9af6b3d82fa33e7e
I20250112 21:02:31.997247 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 287e9340b43a418791e5bcfe7e721720 (table default.Table_c3f61b92787e402a9c6c937605d353cb [id=fb01d5c3322847e0966476ad9030ae15]) successfully deleted
I20250112 21:02:31.997272 23039 ts_tablet_manager.cc:1939] T e5515bf0f1f5419d9af6b3d82fa33e7e P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:31.997248 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 780991d6673a4987a450413a808d2026 (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.997576 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780991d6673a4987a450413a808d2026. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:31.997977 22462 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_4ef72badd3184cdc81f8e4e2062bbb45 [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 3 got 0
I20250112 21:02:31.985757 22882 tablet_service.cc:1467] Processing CreateTablet for tablet 780991d6673a4987a450413a808d2026 (DEFAULT_TABLE table=default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:31.983142 23038 ts_tablet_manager.cc:1939] T e5515bf0f1f5419d9af6b3d82fa33e7e P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:31.999853 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780991d6673a4987a450413a808d2026. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.000372 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet e5515bf0f1f5419d9af6b3d82fa33e7e (table default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]) successfully deleted
I20250112 21:02:32.000828 23034 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.000913 23034 ts_tablet_manager.cc:1397] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250112 21:02:32.001320 23034 raft_consensus.cc:357] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.001416 23034 raft_consensus.cc:383] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.001444 23034 raft_consensus.cc:738] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.001551 23034 consensus_queue.cc:260] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:31.989894 23226 raft_consensus.cc:491] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.001696 23226 raft_consensus.cc:513] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.001788 23034 ts_tablet_manager.cc:1428] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.001928 23034 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.002029 23226 leader_election.cc:290] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.002450 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:31.985597 23084 tablet.cc:1721] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:32.002789 23034 tablet_bootstrap.cc:654] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.002951 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.003062 22782 raft_consensus.cc:2463] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
W20250112 21:02:32.003470 22851 leader_election.cc:343] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.003616 22851 leader_election.cc:304] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.003762 23226 raft_consensus.cc:2798] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.003821 23226 raft_consensus.cc:491] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.003865 23226 raft_consensus.cc:3054] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.004786 23226 raft_consensus.cc:513] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.005111 23226 leader_election.cc:290] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.005214 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet e5515bf0f1f5419d9af6b3d82fa33e7e (table default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]) successfully deleted
I20250112 21:02:32.006846 23037 tablet_bootstrap.cc:492] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.006937 23037 ts_tablet_manager.cc:1397] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.000s
I20250112 21:02:32.007422 23037 raft_consensus.cc:357] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.007526 23037 raft_consensus.cc:383] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.007556 23037 raft_consensus.cc:738] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.007666 23037 consensus_queue.cc:260] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.007932 23037 ts_tablet_manager.cc:1428] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.008112 23037 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.009047 23037 tablet_bootstrap.cc:654] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.010149 23036 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.010224 23036 ts_tablet_manager.cc:1397] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.178s user 0.002s sys 0.000s
I20250112 21:02:32.010282 23034 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.010259 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet c84208a885c54f6c8dfde6f91b1c938a (table default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1 [id=3a02f0bc71554fb4a90c388ed1ad3a11]). Expected version 1 got 0
I20250112 21:02:32.010351 23034 ts_tablet_manager.cc:1397] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250112 21:02:32.010406 22464 catalog_manager.cc:5526] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.010636 22464 catalog_manager.cc:5526] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.010663 23036 raft_consensus.cc:357] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.010756 23036 raft_consensus.cc:383] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.010727 23034 raft_consensus.cc:357] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.010787 23036 raft_consensus.cc:738] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.010807 23034 raft_consensus.cc:383] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.010836 23034 raft_consensus.cc:738] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.010838 22464 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 56914e0635284561adb64897a0dfe37c (table default.Table_43fd2301070a49119af5f07230e04cd0 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 4 got 0
I20250112 21:02:32.010897 23036 consensus_queue.cc:260] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.010931 23034 consensus_queue.cc:260] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.010931 22464 catalog_manager.cc:5526] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.011150 23036 ts_tablet_manager.cc:1428] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.011160 23034 ts_tablet_manager.cc:1428] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.011296 23036 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.011303 23034 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.011943 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.012164 23034 tablet_bootstrap.cc:654] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.012166 23036 tablet_bootstrap.cc:654] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.012179 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.012291 22782 raft_consensus.cc:3054] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:32.012929 22851 leader_election.cc:343] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.013224 22782 raft_consensus.cc:2463] T 32063752131c417abd32c5f0a8400adc P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.013428 22888 tablet_service.cc:1467] Processing CreateTablet for tablet 619dbb3d2f184fbe9a06eddeec251054 (DEFAULT_TABLE table=default.Table_7ffeb53161ed492e92b205fdbd6158af [id=a69549c24a78464baba371d61413ade0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.013707 22895 tablet_service.cc:1467] Processing CreateTablet for tablet 2a400b6263e34de5958ffb3f65083a09 (DEFAULT_TABLE table=default.Table_45334d393f0e40f7bdccaf6a555c37c7 [id=a648f3e28baa4630ba3d086392ab3b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.013707 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 157b61dc4def4c64aa6046c696ca28b8 (DEFAULT_TABLE table=default.Table_bfd32e031d4342b1934105b7a0241d72 [id=c76f0a4c3d6d4118a2748bc8f3cfcad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.013855 22892 tablet_service.cc:1467] Processing CreateTablet for tablet 680b07e8f4664e9caf63843f3914c16b (DEFAULT_TABLE table=default.Table_46d079a6fdc1439ebf5ecc1e5852e534 [id=49c7a0577a9a483084747287832d908a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.014010 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619dbb3d2f184fbe9a06eddeec251054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.014093 22884 tablet_service.cc:1467] Processing CreateTablet for tablet 714d50b52c7a4bc0ad3fd0b029bb6693 (DEFAULT_TABLE table=default.Table_542984b3a25740a29bde2dc4d076eb4c [id=3cc1f6024b9f4d2db19c74b865366bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.014314 22883 tablet_service.cc:1467] Processing CreateTablet for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.014555 22894 tablet_service.cc:1467] Processing CreateTablet for tablet ae4b956e0e7846e687d68ddefe2cd298 (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.013862 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12073b50664f6da79e4daae9483bbf (DEFAULT_TABLE table=default.Table_b8d66a96310443e19fe60081f030c323 [id=5b1713c1ec2c4f44a64d1a0f7640b38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.015303 22851 leader_election.cc:304] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.015337 22882 tablet_service.cc:1467] Processing CreateTablet for tablet 9e65827eb999491bbd346f956170a5aa (DEFAULT_TABLE table=default.Table_8bb86fb98a78465bb1e5cd62ec692d8b [id=ace2aa225dba4b6db6485f180ff66250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.017268 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b07e8f4664e9caf63843f3914c16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.017318 23226 raft_consensus.cc:2798] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.017397 23226 raft_consensus.cc:695] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.017509 23226 consensus_queue.cc:237] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.017686 22887 tablet_service.cc:1467] Processing CreateTablet for tablet b1363a0b11ec4a81b40fb9d78264191f (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.017874 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1363a0b11ec4a81b40fb9d78264191f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.018213 22886 tablet_service.cc:1467] Processing CreateTablet for tablet 00a6b17fc93f437b854bdef9ae47bab8 (DEFAULT_TABLE table=default.Table_e0bbe825854948e092e7cd7016a76e45 [id=7de09de06d204c52ae5a3e083a24234e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.018407 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a6b17fc93f437b854bdef9ae47bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.019469 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d50b52c7a4bc0ad3fd0b029bb6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.019558 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b956e0e7846e687d68ddefe2cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.020426 22886 tablet_service.cc:1467] Processing CreateTablet for tablet b85774d4c8844c22aaf2539da07554dc (DEFAULT_TABLE table=default.Table_c4e1eebe3d744f8fa524536c429323c5 [id=b84c4e25aa26443188980204d30bc587]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.020622 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85774d4c8844c22aaf2539da07554dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.020440 23134 raft_consensus.cc:491] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.021010 23134 raft_consensus.cc:513] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.021247 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12073b50664f6da79e4daae9483bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.021291 23134 leader_election.cc:290] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.022918 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.023459 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.023784 22851 leader_election.cc:343] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.024677 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.024777 22782 raft_consensus.cc:2463] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.025024 22892 tablet_service.cc:1467] Processing CreateTablet for tablet e1854ec7cb6d47539bba1d44c49c8d99 (DEFAULT_TABLE table=default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.025262 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1854ec7cb6d47539bba1d44c49c8d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.026682 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e65827eb999491bbd346f956170a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.025040 22851 leader_election.cc:304] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.027302 23134 raft_consensus.cc:2798] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.027350 23134 raft_consensus.cc:491] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.027385 23134 raft_consensus.cc:3054] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.028108 23134 raft_consensus.cc:513] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.028430 23134 leader_election.cc:290] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.028613 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157b61dc4def4c64aa6046c696ca28b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.030336 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a400b6263e34de5958ffb3f65083a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.031237 23036 tablet_bootstrap.cc:492] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.031307 23036 ts_tablet_manager.cc:1397] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20250112 21:02:32.031713 23036 raft_consensus.cc:357] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.032780 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.032867 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 9e65827eb999491bbd346f956170a5aa (DEFAULT_TABLE table=default.Table_8bb86fb98a78465bb1e5cd62ec692d8b [id=ace2aa225dba4b6db6485f180ff66250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.033097 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e65827eb999491bbd346f956170a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.033226 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.033327 22782 raft_consensus.cc:3054] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:32.033890 22851 leader_election.cc:343] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.034271 22782 raft_consensus.cc:2463] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.034538 22851 leader_election.cc:304] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.034739 23226 raft_consensus.cc:491] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.034803 23226 raft_consensus.cc:513] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.031797 23036 raft_consensus.cc:383] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.035069 23036 raft_consensus.cc:738] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.035077 23226 leader_election.cc:290] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.035202 23036 consensus_queue.cc:260] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.035244 23226 raft_consensus.cc:2798] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.035563 23036 ts_tablet_manager.cc:1428] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:32.035714 23036 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.036168 23226 raft_consensus.cc:695] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.036293 23226 consensus_queue.cc:237] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.036474 22464 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_4ef72badd3184cdc81f8e4e2062bbb45 [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 3 got 0
I20250112 21:02:32.036635 23036 tablet_bootstrap.cc:654] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.036999 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c84208a885c54f6c8dfde6f91b1c938a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.037106 22646 raft_consensus.cc:2463] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.037421 22851 leader_election.cc:304] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.037746 23134 raft_consensus.cc:2798] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.037796 23134 raft_consensus.cc:491] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.037832 23134 raft_consensus.cc:3054] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.038657 23134 raft_consensus.cc:513] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.038965 23134 leader_election.cc:290] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.039424 22780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c84208a885c54f6c8dfde6f91b1c938a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.039557 22780 raft_consensus.cc:3054] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.039682 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c84208a885c54f6c8dfde6f91b1c938a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.039788 22647 raft_consensus.cc:3054] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.040436 22780 raft_consensus.cc:2463] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.040457 22647 raft_consensus.cc:2463] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.040917 22851 leader_election.cc:304] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.041131 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c84208a885c54f6c8dfde6f91b1c938a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.041194 23046 raft_consensus.cc:2798] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.041271 23046 raft_consensus.cc:695] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.041235 22782 raft_consensus.cc:2371] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1. Re-sending same reply.
I20250112 21:02:32.041368 23046 consensus_queue.cc:237] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.041707 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 9e65827eb999491bbd346f956170a5aa (DEFAULT_TABLE table=default.Table_8bb86fb98a78465bb1e5cd62ec692d8b [id=ace2aa225dba4b6db6485f180ff66250]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.041911 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e65827eb999491bbd346f956170a5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.045233 22754 tablet_service.cc:1467] Processing CreateTablet for tablet 157b61dc4def4c64aa6046c696ca28b8 (DEFAULT_TABLE table=default.Table_bfd32e031d4342b1934105b7a0241d72 [id=c76f0a4c3d6d4118a2748bc8f3cfcad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.045290 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 619dbb3d2f184fbe9a06eddeec251054 (DEFAULT_TABLE table=default.Table_7ffeb53161ed492e92b205fdbd6158af [id=a69549c24a78464baba371d61413ade0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.045482 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157b61dc4def4c64aa6046c696ca28b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.045518 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619dbb3d2f184fbe9a06eddeec251054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.046016 22753 tablet_service.cc:1467] Processing CreateTablet for tablet 714d50b52c7a4bc0ad3fd0b029bb6693 (DEFAULT_TABLE table=default.Table_542984b3a25740a29bde2dc4d076eb4c [id=3cc1f6024b9f4d2db19c74b865366bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.046216 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d50b52c7a4bc0ad3fd0b029bb6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.046716 22760 tablet_service.cc:1467] Processing CreateTablet for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.046900 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.047435 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 619dbb3d2f184fbe9a06eddeec251054 (DEFAULT_TABLE table=default.Table_7ffeb53161ed492e92b205fdbd6158af [id=a69549c24a78464baba371d61413ade0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.047540 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 680b07e8f4664e9caf63843f3914c16b (DEFAULT_TABLE table=default.Table_46d079a6fdc1439ebf5ecc1e5852e534 [id=49c7a0577a9a483084747287832d908a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.047626 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619dbb3d2f184fbe9a06eddeec251054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.047746 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b07e8f4664e9caf63843f3914c16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.048689 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 680b07e8f4664e9caf63843f3914c16b (DEFAULT_TABLE table=default.Table_46d079a6fdc1439ebf5ecc1e5852e534 [id=49c7a0577a9a483084747287832d908a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.048904 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680b07e8f4664e9caf63843f3914c16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.049546 22616 tablet_service.cc:1467] Processing CreateTablet for tablet 157b61dc4def4c64aa6046c696ca28b8 (DEFAULT_TABLE table=default.Table_bfd32e031d4342b1934105b7a0241d72 [id=c76f0a4c3d6d4118a2748bc8f3cfcad9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.049579 22464 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_2a59672c5c7940edbf6576966de19785" } new_table_name: "default.Table_1b129250f2c44cb0a094e1d875052ce0" modify_external_catalogs: true
I20250112 21:02:32.049779 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157b61dc4def4c64aa6046c696ca28b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.050894 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 2a400b6263e34de5958ffb3f65083a09 (DEFAULT_TABLE table=default.Table_45334d393f0e40f7bdccaf6a555c37c7 [id=a648f3e28baa4630ba3d086392ab3b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.051110 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a400b6263e34de5958ffb3f65083a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.051954 22617 tablet_service.cc:1467] Processing CreateTablet for tablet 714d50b52c7a4bc0ad3fd0b029bb6693 (DEFAULT_TABLE table=default.Table_542984b3a25740a29bde2dc4d076eb4c [id=3cc1f6024b9f4d2db19c74b865366bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.052157 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d50b52c7a4bc0ad3fd0b029bb6693. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.052217 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 00a6b17fc93f437b854bdef9ae47bab8 (DEFAULT_TABLE table=default.Table_e0bbe825854948e092e7cd7016a76e45 [id=7de09de06d204c52ae5a3e083a24234e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.052464 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a6b17fc93f437b854bdef9ae47bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.052953 22758 tablet_service.cc:1467] Processing CreateTablet for tablet ae4b956e0e7846e687d68ddefe2cd298 (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.053157 22755 tablet_service.cc:1467] Processing CreateTablet for tablet 2a400b6263e34de5958ffb3f65083a09 (DEFAULT_TABLE table=default.Table_45334d393f0e40f7bdccaf6a555c37c7 [id=a648f3e28baa4630ba3d086392ab3b54]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.053334 22616 tablet_service.cc:1467] Processing CreateTablet for tablet 00a6b17fc93f437b854bdef9ae47bab8 (DEFAULT_TABLE table=default.Table_e0bbe825854948e092e7cd7016a76e45 [id=7de09de06d204c52ae5a3e083a24234e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.053531 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a6b17fc93f437b854bdef9ae47bab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.053545 22614 tablet_service.cc:1467] Processing CreateTablet for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3 (DEFAULT_TABLE table=default.Table_671c0651b8794b30baddd5497d7418c6 [id=9e12f645bdf645feb8563162ab6bc364]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.053741 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e37d9a5e9f4973b718f7aa14ca6ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.054591 22617 tablet_service.cc:1467] Processing CreateTablet for tablet b1363a0b11ec4a81b40fb9d78264191f (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.054778 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1363a0b11ec4a81b40fb9d78264191f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.054764 22760 tablet_service.cc:1467] Processing CreateTablet for tablet b1363a0b11ec4a81b40fb9d78264191f (DEFAULT_TABLE table=default.Table_815884d779484b9fb60f34ddfdaa5247 [id=b4978808087d485b9cfb5c707d72db07]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.055133 22615 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12073b50664f6da79e4daae9483bbf (DEFAULT_TABLE table=default.Table_b8d66a96310443e19fe60081f030c323 [id=5b1713c1ec2c4f44a64d1a0f7640b38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.055316 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12073b50664f6da79e4daae9483bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.055608 23460 raft_consensus.cc:491] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.055688 23460 raft_consensus.cc:513] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.056092 23460 leader_election.cc:290] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.056167 23460 raft_consensus.cc:491] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.056233 23460 raft_consensus.cc:513] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.056471 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aad32a4d5f40c69b28219f0cc42538" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.056526 23460 leader_election.cc:290] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:32.056907 22717 leader_election.cc:343] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.056979 22753 tablet_service.cc:1467] Processing CreateTablet for tablet b85774d4c8844c22aaf2539da07554dc (DEFAULT_TABLE table=default.Table_c4e1eebe3d744f8fa524536c429323c5 [id=b84c4e25aa26443188980204d30bc587]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.057009 22626 tablet_service.cc:1467] Processing CreateTablet for tablet ae4b956e0e7846e687d68ddefe2cd298 (DEFAULT_TABLE table=default.Table_55525039c39c4f39b6f415812ca5875e [id=371a73d7e8ae4a68aed976398998ce23]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.057163 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.057214 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b956e0e7846e687d68ddefe2cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.057301 22616 tablet_service.cc:1467] Processing CreateTablet for tablet b85774d4c8844c22aaf2539da07554dc (DEFAULT_TABLE table=default.Table_c4e1eebe3d744f8fa524536c429323c5 [id=b84c4e25aa26443188980204d30bc587]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.057492 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85774d4c8844c22aaf2539da07554dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:32.057463 22717 leader_election.cc:343] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.060732 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.061058 22715 leader_election.cc:343] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.061122 22715 leader_election.cc:304] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
W20250112 21:02:32.061250 22464 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d727069e2614af5a7d1d40a6035b2e8 consensus state has no leader
I20250112 21:02:32.061312 23065 raft_consensus.cc:2743] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.062014 22614 tablet_service.cc:1467] Processing CreateTablet for tablet e1854ec7cb6d47539bba1d44c49c8d99 (DEFAULT_TABLE table=default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.062253 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1854ec7cb6d47539bba1d44c49c8d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.062402 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aad32a4d5f40c69b28219f0cc42538" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.062728 22715 leader_election.cc:343] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.062796 22715 leader_election.cc:304] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.062975 23065 raft_consensus.cc:2743] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.064021 22612 tablet_service.cc:1514] Processing DeleteTablet for tablet b40002b2a71741d9833974adc89e0c4e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.064502 22761 tablet_service.cc:1467] Processing CreateTablet for tablet 9a12073b50664f6da79e4daae9483bbf (DEFAULT_TABLE table=default.Table_b8d66a96310443e19fe60081f030c323 [id=5b1713c1ec2c4f44a64d1a0f7640b38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.064999 22754 tablet_service.cc:1467] Processing CreateTablet for tablet e1854ec7cb6d47539bba1d44c49c8d99 (DEFAULT_TABLE table=default.Table_f29a6392084f462fadb2d8d4ab6da8c6 [id=ba7360d4d2ea4e8d97026628ebd39bd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.065085 22647 raft_consensus.cc:1270] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.053145 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b956e0e7846e687d68ddefe2cd298. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.065349 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85774d4c8844c22aaf2539da07554dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.065428 23460 consensus_queue.cc:1035] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.065469 23226 raft_consensus.cc:491] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.065565 23226 raft_consensus.cc:513] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.065917 23226 leader_election.cc:290] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.066094 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a400b6263e34de5958ffb3f65083a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.068122 22457 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_4ef72badd3184cdc81f8e4e2062bbb45 [id=01456c35f2ab4b4791ff53ac176be72e] alter complete (version 3)
I20250112 21:02:32.068476 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1363a0b11ec4a81b40fb9d78264191f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.069031 22457 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (table default.Table_8e24beac6ddf4937af42e19af45baf3f [id=95803b5342bb4561be8bc0478cc8ca6e]). Expected version 1 got 0
I20250112 21:02:32.070963 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1854ec7cb6d47539bba1d44c49c8d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.071228 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet e5515bf0f1f5419d9af6b3d82fa33e7e with delete_type TABLET_DATA_DELETED (replaced by tablet e1854ec7cb6d47539bba1d44c49c8d99) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.072808 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a12073b50664f6da79e4daae9483bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.074892 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.075024 22781 raft_consensus.cc:2463] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.075326 22917 raft_consensus.cc:3054] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.076331 22917 raft_consensus.cc:1270] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.076552 23084 tablet.cc:1716] T 458bbc607af0400d93fe7990999d90b9 P 3423673c659e4427958b13fc9eaa714d: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:32.076906 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet ff5d7de8faa34adcb63f76151d8ab5e9 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.070945 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet f0aad32a4d5f40c69b28219f0cc42538 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:31 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.077721 23406 tablet.cc:1716] T 458bbc607af0400d93fe7990999d90b9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:32.078029 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.078516 22851 leader_election.cc:304] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.078686 23134 raft_consensus.cc:2798] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.078734 23134 raft_consensus.cc:491] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250112 21:02:32.078742 22851 leader_election.cc:343] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.078812 23134 raft_consensus.cc:3054] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.078927 23460 raft_consensus.cc:491] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.078996 23460 raft_consensus.cc:513] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.079303 23460 leader_election.cc:290] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.079692 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.079711 23134 raft_consensus.cc:513] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.080019 23134 leader_election.cc:290] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
W20250112 21:02:32.080013 22715 leader_election.cc:343] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.080511 23460 consensus_queue.cc:1035] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.081065 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.081163 22781 raft_consensus.cc:3054] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.081658 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.081918 22457 catalog_manager.cc:6596] ReplaceTablet: tablet ff5d7de8faa34adcb63f76151d8ab5e9 deleted and replaced by tablet d4ac0afdf7ee4ca894d9c7375e5caef8
I20250112 21:02:32.082299 22781 raft_consensus.cc:2463] T 7d5332ec945740f0a998b1fb9848387a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.082736 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.082840 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 with delete_type TABLET_DATA_DELETED (replaced by tablet d4ac0afdf7ee4ca894d9c7375e5caef8) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.083017 22851 leader_election.cc:304] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.082839 22917 raft_consensus.cc:2463] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:32.083124 23038 tablet_replica.cc:331] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.083360 23038 raft_consensus.cc:2238] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.083460 23038 raft_consensus.cc:2267] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.083806 23134 raft_consensus.cc:2798] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.083921 23038 ts_tablet_manager.cc:1905] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.083976 23134 raft_consensus.cc:695] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.084086 23134 consensus_queue.cc:237] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.085955 23038 ts_tablet_manager.cc:1918] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.086016 23038 log.cc:1198] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.086210 23038 ts_tablet_manager.cc:1939] T ff5d7de8faa34adcb63f76151d8ab5e9 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.087420 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.087689 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet ff5d7de8faa34adcb63f76151d8ab5e9 (table default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]) successfully deleted
W20250112 21:02:32.088699 22851 leader_election.cc:343] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.088980 22717 leader_election.cc:304] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.089202 23460 raft_consensus.cc:2798] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.089257 23460 raft_consensus.cc:491] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.089293 23460 raft_consensus.cc:3054] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.090142 23460 raft_consensus.cc:513] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.090483 23460 leader_election.cc:290] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.091272 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.091547 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56914e0635284561adb64897a0dfe37c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
W20250112 21:02:32.091624 22715 leader_election.cc:343] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.091641 22917 raft_consensus.cc:3054] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.092490 22917 raft_consensus.cc:2463] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:32.092753 22717 leader_election.cc:304] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.092895 23460 raft_consensus.cc:2798] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.092990 23460 raft_consensus.cc:695] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:32.093106 23460 consensus_queue.cc:237] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.096783 23039 tablet_replica.cc:331] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.096956 23039 raft_consensus.cc:2238] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.097107 23039 raft_consensus.cc:2267] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:32.097805 22450 catalog_manager.cc:4839] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet b40002b2a71741d9833974adc89e0c4e because the tablet was not found. No further retry: Not found: Tablet not found: b40002b2a71741d9833974adc89e0c4e
W20250112 21:02:32.097944 22457 catalog_manager.cc:5359] Ignoring report from unknown tablet d19c73dce51147e29837df3b364af790
W20250112 21:02:32.098066 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet e5515bf0f1f5419d9af6b3d82fa33e7e because the tablet was not found. No further retry: Not found: Tablet not found: e5515bf0f1f5419d9af6b3d82fa33e7e
I20250112 21:02:32.098285 22457 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.098580 23039 ts_tablet_manager.cc:1905] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:32.098776 22457 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 77617388a31447f196febf2980f3f410 consensus state has no leader
I20250112 21:02:32.098999 22612 tablet_service.cc:1514] Processing DeleteTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 with delete_type TABLET_DATA_DELETED (replaced by tablet d4ac0afdf7ee4ca894d9c7375e5caef8) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.099094 22464 catalog_manager.cc:5526] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.099351 22464 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (table default.Table_8e24beac6ddf4937af42e19af45baf3f [id=95803b5342bb4561be8bc0478cc8ca6e]). Expected version 1 got 0
I20250112 21:02:32.099452 22464 catalog_manager.cc:5526] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:32.099653 22464 catalog_manager.cc:5526] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.099785 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 with delete_type TABLET_DATA_DELETED (replaced by tablet d4ac0afdf7ee4ca894d9c7375e5caef8) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.099813 22464 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet c84208a885c54f6c8dfde6f91b1c938a (table default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1 [id=3a02f0bc71554fb4a90c388ed1ad3a11]). Expected version 1 got 0
I20250112 21:02:32.100811 23039 ts_tablet_manager.cc:1918] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.100873 23039 log.cc:1198] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:32.101061 23039 ts_tablet_manager.cc:1939] T f0aad32a4d5f40c69b28219f0cc42538 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.101707 23039 tablet_replica.cc:331] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.101863 23039 raft_consensus.cc:2238] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.102007 23039 raft_consensus.cc:2267] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.102023 23415 mvcc.cc:204] Tried to move back new op lower bound from 7113587717683470336 to 7113587711998459904. Current Snapshot: MvccSnapshot[applied={T|T < 7113587717683470336 or (T in {7113587717683470336})}]
I20250112 21:02:32.102998 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet f0aad32a4d5f40c69b28219f0cc42538 (table default.Table_5487430f075043b691e493891c986d07 [id=8ef8b7c86df94166b526d83a12e78cd5]) successfully deleted
W20250112 21:02:32.103144 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet ff5d7de8faa34adcb63f76151d8ab5e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff5d7de8faa34adcb63f76151d8ab5e9 already in progress: creating tablet
I20250112 21:02:32.103902 23037 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.103998 23037 ts_tablet_manager.cc:1397] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.000s
I20250112 21:02:32.104544 23037 raft_consensus.cc:357] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.104653 23037 raft_consensus.cc:383] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.104682 23037 raft_consensus.cc:738] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.104794 23037 consensus_queue.cc:260] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.105052 23037 ts_tablet_manager.cc:1428] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.105265 23037 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
W20250112 21:02:32.105738 22453 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 6d727069e2614af5a7d1d40a6035b2e8 (table default.Table_1b129250f2c44cb0a094e1d875052ce0 [id=49c5d4af135743bf9883af3ace89ce22], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6d727069e2614af5a7d1d40a6035b2e8 consensus state has no leader
I20250112 21:02:32.106186 23037 tablet_bootstrap.cc:654] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:32.106281 22464 catalog_manager.cc:5359] Ignoring report from unknown tablet 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:32.106278 22457 catalog_manager.cc:5526] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.107151 22457 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 56914e0635284561adb64897a0dfe37c (table default.Table_43fd2301070a49119af5f07230e04cd0 [id=83aa4d12b5d24a628351eb0a6b975cb7]). Expected version 4 got 0
I20250112 21:02:32.107892 22464 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_78295df1f6bd4a6694a742e692d31fa5" } modify_external_catalogs: true
I20250112 21:02:32.107988 22464 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_78295df1f6bd4a6694a742e692d31fa5" } modify_external_catalogs: true
W20250112 21:02:32.108590 22460 catalog_manager.cc:5359] Ignoring report from unknown tablet 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:32.109969 23118 consensus_queue.cc:1035] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.113304 22460 catalog_manager.cc:5526] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:32.113409 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet bd52409ed391433491b65bb00d33b36a
I20250112 21:02:32.113534 22460 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 0d4e55df14b84ca9af9fb2ee73022bb8 (table default.Table_8e24beac6ddf4937af42e19af45baf3f [id=95803b5342bb4561be8bc0478cc8ca6e]). Expected version 1 got 0
I20250112 21:02:32.114102 22612 tablet_service.cc:1514] Processing DeleteTablet for tablet bd52409ed391433491b65bb00d33b36a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.115034 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet bd52409ed391433491b65bb00d33b36a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:32.115934 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet bd52409ed391433491b65bb00d33b36a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd52409ed391433491b65bb00d33b36a already in progress: creating tablet
I20250112 21:02:32.115986 23406 tablet.cc:1721] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250112 21:02:32.116685 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet bd52409ed391433491b65bb00d33b36a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd52409ed391433491b65bb00d33b36a already in progress: creating tablet
I20250112 21:02:32.117071 23039 ts_tablet_manager.cc:1905] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.119065 23354 tablet.cc:1721] T 0d4e55df14b84ca9af9fb2ee73022bb8 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.120699 23034 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.120788 23034 ts_tablet_manager.cc:1397] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.110s user 0.001s sys 0.000s
I20250112 21:02:32.121220 23034 raft_consensus.cc:357] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.121312 23034 raft_consensus.cc:383] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.121342 23034 raft_consensus.cc:738] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.121441 23034 consensus_queue.cc:260] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.121703 23034 ts_tablet_manager.cc:1428] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:32.121851 23034 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.122745 23034 tablet_bootstrap.cc:654] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.124693 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet bd52409ed391433491b65bb00d33b36a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.125294 23036 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.125376 23036 ts_tablet_manager.cc:1397] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.000s
I20250112 21:02:32.125820 23036 raft_consensus.cc:357] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.125919 23036 raft_consensus.cc:383] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.125947 23036 raft_consensus.cc:738] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.126057 23036 consensus_queue.cc:260] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.126313 23036 ts_tablet_manager.cc:1428] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.126495 23036 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.127257 22460 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_8e24beac6ddf4937af42e19af45baf3f [id=95803b5342bb4561be8bc0478cc8ca6e] alter complete (version 1)
I20250112 21:02:32.127355 23036 tablet_bootstrap.cc:654] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.128573 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0" } modify_external_catalogs: true
I20250112 21:02:32.128671 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0" } modify_external_catalogs: true
I20250112 21:02:32.129412 23082 raft_consensus.cc:491] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.129487 23082 raft_consensus.cc:513] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.129808 23082 leader_election.cc:290] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.120692 23039 ts_tablet_manager.cc:1918] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.130173 23039 log.cc:1198] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.130142 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.130366 23039 ts_tablet_manager.cc:1939] T ff5d7de8faa34adcb63f76151d8ab5e9 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
W20250112 21:02:32.130479 22715 leader_election.cc:343] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.134348 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 5e6369517eed414295e2b23769bb5cf6
I20250112 21:02:32.135109 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6369517eed414295e2b23769bb5cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.135763 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.135995 22647 raft_consensus.cc:1270] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.136381 22782 raft_consensus.cc:1270] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.136480 23036 tablet_bootstrap.cc:492] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.136548 23036 ts_tablet_manager.cc:1397] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:32.136962 23036 raft_consensus.cc:357] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.137058 23036 raft_consensus.cc:383] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.137089 23036 raft_consensus.cc:738] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.137192 23036 consensus_queue.cc:260] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.137473 23036 ts_tablet_manager.cc:1428] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20250112 21:02:32.137490 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 5e6369517eed414295e2b23769bb5cf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6369517eed414295e2b23769bb5cf6 already in progress: creating tablet
I20250112 21:02:32.137635 23036 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.138566 23036 tablet_bootstrap.cc:654] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.143340 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_97936dd45d9b496cbbd47d899dfa6433" } modify_external_catalogs: true
I20250112 21:02:32.143450 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_97936dd45d9b496cbbd47d899dfa6433" } modify_external_catalogs: true
I20250112 21:02:32.144124 23036 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.144201 23036 ts_tablet_manager.cc:1397] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:32.144634 23036 raft_consensus.cc:357] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.144737 23036 raft_consensus.cc:383] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.144773 23036 raft_consensus.cc:738] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.144873 23036 consensus_queue.cc:260] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.145114 23036 ts_tablet_manager.cc:1428] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.145252 23036 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.145494 22464 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c4e1eebe3d744f8fa524536c429323c5" } modify_external_catalogs: true
I20250112 21:02:32.145587 22464 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c4e1eebe3d744f8fa524536c429323c5" } modify_external_catalogs: true
I20250112 21:02:32.145637 23049 consensus_queue.cc:1035] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.146147 23036 tablet_bootstrap.cc:654] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.146342 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_3da7061174aa4a1a9bb10372fa3e7bcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.146656 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3da7061174aa4a1a9bb10372fa3e7bcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.147336 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_7e4925c30bba424abbd299e6bc835675"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.147624 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e4925c30bba424abbd299e6bc835675 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.148018 23036 tablet_bootstrap.cc:492] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.148098 23036 ts_tablet_manager.cc:1397] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:32.148265 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_17179b9f156944a191777a7a68441af4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.148558 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17179b9f156944a191777a7a68441af4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.148531 23036 raft_consensus.cc:357] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.148617 23036 raft_consensus.cc:383] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.148654 23036 raft_consensus.cc:738] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.148757 23036 consensus_queue.cc:260] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.149005 23036 ts_tablet_manager.cc:1428] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.149168 23036 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.150014 23036 tablet_bootstrap.cc:654] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.151140 23046 consensus_queue.cc:1035] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.151707 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_8108dc78db2345f1aef3996f97470431"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:32.151881 23046 consensus_queue.cc:1035] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:32.151985 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8108dc78db2345f1aef3996f97470431 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.152772 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_7b9905591b8c411584faf5db4d1a92f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.153021 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b9905591b8c411584faf5db4d1a92f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.153466 23036 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.153537 23036 ts_tablet_manager.cc:1397] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:32.153790 22465 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_09ca0502b0094be69211b7297b83e76b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:32.153952 23036 raft_consensus.cc:357] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.154038 23036 raft_consensus.cc:383] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250112 21:02:32.154047 22465 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09ca0502b0094be69211b7297b83e76b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.154067 23036 raft_consensus.cc:738] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.154181 23036 consensus_queue.cc:260] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.154418 23036 ts_tablet_manager.cc:1428] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.154572 23036 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.154891 23065 raft_consensus.cc:491] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.154978 23065 raft_consensus.cc:513] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.155315 23065 leader_election.cc:290] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.155390 23036 tablet_bootstrap.cc:654] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.155756 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c73dce51147e29837df3b364af790" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.156245 22715 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.156630 23036 tablet_bootstrap.cc:492] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.156701 23036 ts_tablet_manager.cc:1397] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:32.157073 23036 raft_consensus.cc:357] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.157158 23036 raft_consensus.cc:383] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.157188 23036 raft_consensus.cc:738] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.157282 23036 consensus_queue.cc:260] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.157538 23036 ts_tablet_manager.cc:1428] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:32.157680 23036 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.157841 23084 tablet.cc:1721] T 0d4e55df14b84ca9af9fb2ee73022bb8 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.158494 23036 tablet_bootstrap.cc:654] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.159379 23036 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.159451 23036 ts_tablet_manager.cc:1397] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250112 21:02:32.159817 23036 raft_consensus.cc:357] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.159909 23036 raft_consensus.cc:383] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.159937 23036 raft_consensus.cc:738] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.160030 23036 consensus_queue.cc:260] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.160277 23036 ts_tablet_manager.cc:1428] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:32.160444 23036 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:32.160472 22717 leader_election.cc:343] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.160530 22717 leader_election.cc:304] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.160852 23065 raft_consensus.cc:2743] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.160938 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 0c50b95d782e420a8e32acf58f95d85a
I20250112 21:02:32.161378 23036 tablet_bootstrap.cc:654] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.161542 22464 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet b85774d4c8844c22aaf2539da07554dc
I20250112 21:02:32.163239 22887 tablet_service.cc:1514] Processing DeleteTablet for tablet b85774d4c8844c22aaf2539da07554dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.163324 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c50b95d782e420a8e32acf58f95d85a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.164880 23036 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.164953 23036 ts_tablet_manager.cc:1397] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20250112 21:02:32.165143 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet b85774d4c8844c22aaf2539da07554dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b85774d4c8844c22aaf2539da07554dc already in progress: creating tablet
W20250112 21:02:32.165324 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 0c50b95d782e420a8e32acf58f95d85a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c50b95d782e420a8e32acf58f95d85a already in progress: creating tablet
I20250112 21:02:32.165367 23036 raft_consensus.cc:357] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.165474 23036 raft_consensus.cc:383] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.165485 23037 tablet_bootstrap.cc:492] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.165506 23036 raft_consensus.cc:738] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.165560 23037 ts_tablet_manager.cc:1397] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20250112 21:02:32.165624 23036 consensus_queue.cc:260] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.165877 23036 ts_tablet_manager.cc:1428] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.166023 23036 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.166297 23037 raft_consensus.cc:357] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.166474 23037 raft_consensus.cc:383] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.166546 23037 raft_consensus.cc:738] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.166726 23037 consensus_queue.cc:260] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.166874 23036 tablet_bootstrap.cc:654] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.169121 23037 ts_tablet_manager.cc:1428] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:32.170156 23037 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.171128 23037 tablet_bootstrap.cc:654] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.174000 23084 tablet.cc:1721] T c84208a885c54f6c8dfde6f91b1c938a P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250112 21:02:32.177696 22717 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: d19c73dce51147e29837df3b364af790
I20250112 21:02:32.177783 22717 leader_election.cc:304] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.177927 23460 raft_consensus.cc:2743] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.178094 22462 master_service.cc:946] ReplaceTablet: received request to replace tablet 5a057bfc6f20435fb6b6d0dacff66136 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.178164 22461 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d3f9cdd5b59474f953fa0099553262f from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.180126 22466 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_9d4cd578620c44e4991b125af874b287" } modify_external_catalogs: true
I20250112 21:02:32.180141 22463 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_0af1b886425c45f0b7e33eb26e8f2796" } new_table_name: "default.Table_63f8fa00f02e45248b19a656719cce8f" modify_external_catalogs: true
I20250112 21:02:32.180274 22466 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_9d4cd578620c44e4991b125af874b287" } modify_external_catalogs: true
I20250112 21:02:32.180717 22460 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_b1ee32bb31724a41ad80a07975029bd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.181051 22460 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1ee32bb31724a41ad80a07975029bd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.181138 22464 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_671c0651b8794b30baddd5497d7418c6" } new_table_name: "default.Table_7df0c1c7d25a46e6b3ff43d441ac4293" modify_external_catalogs: true
I20250112 21:02:32.181890 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_b2bb5b185c4b4addafea721c3334ad27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.182175 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2bb5b185c4b4addafea721c3334ad27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.182878 22457 master_service.cc:946] ReplaceTablet: received request to replace tablet 79963c1d3d8e45e9b94908efd6487cdb from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.183610 22612 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6369517eed414295e2b23769bb5cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.183784 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c50b95d782e420a8e32acf58f95d85a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.184346 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet b85774d4c8844c22aaf2539da07554dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.184862 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet ff5d7de8faa34adcb63f76151d8ab5e9 (table default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]) successfully deleted
W20250112 21:02:32.184976 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet bd52409ed391433491b65bb00d33b36a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd52409ed391433491b65bb00d33b36a already in progress: creating tablet
W20250112 21:02:32.185163 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 5e6369517eed414295e2b23769bb5cf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6369517eed414295e2b23769bb5cf6 already in progress: creating tablet
W20250112 21:02:32.185201 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet f0aad32a4d5f40c69b28219f0cc42538
W20250112 21:02:32.185258 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 0c50b95d782e420a8e32acf58f95d85a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c50b95d782e420a8e32acf58f95d85a already in progress: creating tablet
I20250112 21:02:32.185309 22458 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet c84208a885c54f6c8dfde6f91b1c938a (table default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1 [id=3a02f0bc71554fb4a90c388ed1ad3a11]). Expected version 1 got 0
W20250112 21:02:32.185350 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet b85774d4c8844c22aaf2539da07554dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b85774d4c8844c22aaf2539da07554dc already in progress: creating tablet
I20250112 21:02:32.185467 22760 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6369517eed414295e2b23769bb5cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.185608 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c50b95d782e420a8e32acf58f95d85a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.185707 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet b85774d4c8844c22aaf2539da07554dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
W20250112 21:02:32.186350 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 5e6369517eed414295e2b23769bb5cf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6369517eed414295e2b23769bb5cf6 already in progress: creating tablet
W20250112 21:02:32.186483 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 0c50b95d782e420a8e32acf58f95d85a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c50b95d782e420a8e32acf58f95d85a already in progress: creating tablet
W20250112 21:02:32.186578 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet b85774d4c8844c22aaf2539da07554dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b85774d4c8844c22aaf2539da07554dc already in progress: creating tablet
I20250112 21:02:32.188373 23354 tablet.cc:1721] T c84208a885c54f6c8dfde6f91b1c938a P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.189411 22461 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 1d3f9cdd5b59474f953fa0099553262f
I20250112 21:02:32.189693 22461 catalog_manager.cc:6596] ReplaceTablet: tablet 1d3f9cdd5b59474f953fa0099553262f deleted and replaced by tablet 4928f2de8b3a4b2db30165b304553eac
I20250112 21:02:32.190160 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3f9cdd5b59474f953fa0099553262f with delete_type TABLET_DATA_DELETED (replaced by tablet 4928f2de8b3a4b2db30165b304553eac) from {username='slave'} at 127.0.0.1:38002
W20250112 21:02:32.190349 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet 1ded0955d63e42d78453ee94a59d413d
W20250112 21:02:32.190387 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet dfdbdb92c2f5441796e20643a5e02a80
W20250112 21:02:32.190403 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet 0db56f76b0b7473bb5d70463ec5b2484
W20250112 21:02:32.190470 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:32.190673 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3f9cdd5b59474f953fa0099553262f with delete_type TABLET_DATA_DELETED (replaced by tablet 4928f2de8b3a4b2db30165b304553eac) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.192255 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3f9cdd5b59474f953fa0099553262f with delete_type TABLET_DATA_DELETED (replaced by tablet 4928f2de8b3a4b2db30165b304553eac) from {username='slave'} at 127.0.0.1:44696
W20250112 21:02:32.192435 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 1d3f9cdd5b59474f953fa0099553262f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3f9cdd5b59474f953fa0099553262f already in progress: creating tablet
W20250112 21:02:32.192744 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 1d3f9cdd5b59474f953fa0099553262f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3f9cdd5b59474f953fa0099553262f already in progress: creating tablet
W20250112 21:02:32.192939 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 1d3f9cdd5b59474f953fa0099553262f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3f9cdd5b59474f953fa0099553262f already in progress: creating tablet
I20250112 21:02:32.193506 23034 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.193521 23037 tablet_bootstrap.cc:492] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.193600 23037 ts_tablet_manager.cc:1397] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20250112 21:02:32.193600 23034 ts_tablet_manager.cc:1397] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.001s
I20250112 21:02:32.194046 23034 raft_consensus.cc:357] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.194156 23034 raft_consensus.cc:383] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.194195 23034 raft_consensus.cc:738] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.194339 23034 consensus_queue.cc:260] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.194523 23037 raft_consensus.cc:357] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.194612 23034 ts_tablet_manager.cc:1428] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250112 21:02:32.194677 23037 raft_consensus.cc:383] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.194738 23037 raft_consensus.cc:738] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.194793 23034 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.194917 23037 consensus_queue.cc:260] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.195209 23037 ts_tablet_manager.cc:1428] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.195426 23037 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.195664 23034 tablet_bootstrap.cc:654] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.197103 22462 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 5a057bfc6f20435fb6b6d0dacff66136
I20250112 21:02:32.197358 22462 catalog_manager.cc:6596] ReplaceTablet: tablet 5a057bfc6f20435fb6b6d0dacff66136 deleted and replaced by tablet b028cb5715bc494486dc374b47f33605
I20250112 21:02:32.197521 22462 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c65081e9a22142babc740190cb3a96b7" } new_table_name: "default.Table_93d3f705b83f46e99475a154b7e1933e" modify_external_catalogs: true
I20250112 21:02:32.198467 22465 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet c84208a885c54f6c8dfde6f91b1c938a (table default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1 [id=3a02f0bc71554fb4a90c388ed1ad3a11]). Expected version 1 got 0
I20250112 21:02:32.198866 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 with delete_type TABLET_DATA_DELETED (replaced by tablet b028cb5715bc494486dc374b47f33605) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.199177 22461 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.199260 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 with delete_type TABLET_DATA_DELETED (replaced by tablet b028cb5715bc494486dc374b47f33605) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.199397 23039 tablet_replica.cc:331] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.199518 23039 raft_consensus.cc:2238] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.199612 23039 raft_consensus.cc:2267] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.199843 22463 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_6df6d7e9961f4c82b5c3606a93d75a1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:32.200027 23039 ts_tablet_manager.cc:1905] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:32.200138 22463 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6df6d7e9961f4c82b5c3606a93d75a1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.201702 22465 master_service.cc:946] ReplaceTablet: received request to replace tablet 43b4420df3e84c1888043baa9f2dd692 from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.202107 23039 ts_tablet_manager.cc:1918] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.202172 23039 log.cc:1198] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/5a057bfc6f20435fb6b6d0dacff66136
I20250112 21:02:32.202351 23039 ts_tablet_manager.cc:1939] T 5a057bfc6f20435fb6b6d0dacff66136 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.202526 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 with delete_type TABLET_DATA_DELETED (replaced by tablet b028cb5715bc494486dc374b47f33605) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:32.203846 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 5a057bfc6f20435fb6b6d0dacff66136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a057bfc6f20435fb6b6d0dacff66136 already in progress: creating tablet
W20250112 21:02:32.205937 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 5a057bfc6f20435fb6b6d0dacff66136 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a057bfc6f20435fb6b6d0dacff66136 already in progress: creating tablet
I20250112 21:02:32.207244 23354 tablet.cc:1721] T 8a0e4f4b5f194bb99049fecc2b256b08 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.208249 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 5a057bfc6f20435fb6b6d0dacff66136 (table default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]) successfully deleted
I20250112 21:02:32.209875 23036 tablet_bootstrap.cc:492] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.209960 23036 ts_tablet_manager.cc:1397] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.000s
I20250112 21:02:32.210418 23036 raft_consensus.cc:357] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.210522 23036 raft_consensus.cc:383] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.210554 23036 raft_consensus.cc:738] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.210661 23036 consensus_queue.cc:260] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.210922 23036 ts_tablet_manager.cc:1428] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.211078 23036 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.211995 23036 tablet_bootstrap.cc:654] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.212905 23406 tablet.cc:1721] T 8a0e4f4b5f194bb99049fecc2b256b08 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.214329 23406 tablet.cc:1721] T c84208a885c54f6c8dfde6f91b1c938a P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.217551 23034 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.217625 23034 ts_tablet_manager.cc:1397] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20250112 21:02:32.218014 23034 raft_consensus.cc:357] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.218109 23034 raft_consensus.cc:383] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.218140 23034 raft_consensus.cc:738] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.218257 23034 consensus_queue.cc:260] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.218528 23034 ts_tablet_manager.cc:1428] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.218695 23034 tablet_bootstrap.cc:492] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:32.219920 22464 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2e37d9a5e9f4973b718f7aa14ca6ab3 consensus state has no leader
I20250112 21:02:32.219849 23034 tablet_bootstrap.cc:654] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.223182 23036 tablet_bootstrap.cc:492] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.223268 23036 ts_tablet_manager.cc:1397] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250112 21:02:32.223291 23034 tablet_bootstrap.cc:492] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.223352 23034 ts_tablet_manager.cc:1397] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250112 21:02:32.223713 23036 raft_consensus.cc:357] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.223732 23034 raft_consensus.cc:357] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.223814 23034 raft_consensus.cc:383] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.223814 23036 raft_consensus.cc:383] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.223843 23034 raft_consensus.cc:738] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.223843 23036 raft_consensus.cc:738] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.223937 23036 consensus_queue.cc:260] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.223937 23034 consensus_queue.cc:260] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.224176 23034 ts_tablet_manager.cc:1428] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.224184 23036 ts_tablet_manager.cc:1428] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.224331 23036 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.224331 23034 tablet_bootstrap.cc:492] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.225248 23034 tablet_bootstrap.cc:654] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.225376 23036 tablet_bootstrap.cc:654] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.225802 22466 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 4928f2de8b3a4b2db30165b304553eac
W20250112 21:02:32.226364 22462 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e4598f42f64b4354af0cfb53826d59e3 consensus state has no leader
I20250112 21:02:32.226827 22457 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 79963c1d3d8e45e9b94908efd6487cdb
I20250112 21:02:32.227094 22457 catalog_manager.cc:6596] ReplaceTablet: tablet 79963c1d3d8e45e9b94908efd6487cdb deleted and replaced by tablet feed94806b85451e98bc1700aa3aa7be
I20250112 21:02:32.227383 22458 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_6c9a7cd845a74835ba803e6d3d876b0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.227737 22458 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c9a7cd845a74835ba803e6d3d876b0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.228710 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb with delete_type TABLET_DATA_DELETED (replaced by tablet feed94806b85451e98bc1700aa3aa7be) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.230363 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb with delete_type TABLET_DATA_DELETED (replaced by tablet feed94806b85451e98bc1700aa3aa7be) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.230540 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb with delete_type TABLET_DATA_DELETED (replaced by tablet feed94806b85451e98bc1700aa3aa7be) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.230710 23039 tablet_replica.cc:331] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.230831 23039 raft_consensus.cc:2238] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.230917 23039 raft_consensus.cc:2267] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:32.231042 22463 catalog_manager.cc:5359] Ignoring report from unknown tablet df5959512e2f4b23a8c275653cbce77c
W20250112 21:02:32.231611 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 79963c1d3d8e45e9b94908efd6487cdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79963c1d3d8e45e9b94908efd6487cdb already in progress: creating tablet
W20250112 21:02:32.231971 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 79963c1d3d8e45e9b94908efd6487cdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 79963c1d3d8e45e9b94908efd6487cdb already in progress: creating tablet
I20250112 21:02:32.232010 23039 ts_tablet_manager.cc:1905] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.232928 23084 tablet.cc:1721] T 8a0e4f4b5f194bb99049fecc2b256b08 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.234052 23039 ts_tablet_manager.cc:1918] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.234109 23039 log.cc:1198] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/79963c1d3d8e45e9b94908efd6487cdb
I20250112 21:02:32.234289 23039 ts_tablet_manager.cc:1939] T 79963c1d3d8e45e9b94908efd6487cdb P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.235225 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 79963c1d3d8e45e9b94908efd6487cdb (table default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]) successfully deleted
I20250112 21:02:32.238075 23034 tablet_bootstrap.cc:492] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.238135 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 43b4420df3e84c1888043baa9f2dd692
I20250112 21:02:32.238399 22465 catalog_manager.cc:6596] ReplaceTablet: tablet 43b4420df3e84c1888043baa9f2dd692 deleted and replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925
I20250112 21:02:32.239136 22761 tablet_service.cc:1514] Processing DeleteTablet for tablet 43b4420df3e84c1888043baa9f2dd692 with delete_type TABLET_DATA_DELETED (replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.239285 22614 tablet_service.cc:1514] Processing DeleteTablet for tablet 43b4420df3e84c1888043baa9f2dd692 with delete_type TABLET_DATA_DELETED (replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.239382 23037 tablet_bootstrap.cc:654] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.239761 23039 tablet_replica.cc:331] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.239884 23039 raft_consensus.cc:2238] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.239967 23039 raft_consensus.cc:2267] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.240298 23039 ts_tablet_manager.cc:1905] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.241690 23039 ts_tablet_manager.cc:1918] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.241734 23039 log.cc:1198] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/43b4420df3e84c1888043baa9f2dd692
I20250112 21:02:32.241858 23039 ts_tablet_manager.cc:1939] T 43b4420df3e84c1888043baa9f2dd692 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
W20250112 21:02:32.242051 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 43b4420df3e84c1888043baa9f2dd692 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43b4420df3e84c1888043baa9f2dd692 already in progress: creating tablet
I20250112 21:02:32.242434 23034 ts_tablet_manager.cc:1397] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250112 21:02:32.242641 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 43b4420df3e84c1888043baa9f2dd692 (table default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]) successfully deleted
I20250112 21:02:32.242784 22460 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_7a7c6d4a621644e6a265b0f37fc4b4e1 [id=3a02f0bc71554fb4a90c388ed1ad3a11] alter complete (version 1)
I20250112 21:02:32.244673 23034 raft_consensus.cc:357] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.244771 23034 raft_consensus.cc:383] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.244798 23034 raft_consensus.cc:738] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.244908 23034 consensus_queue.cc:260] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.245164 23034 ts_tablet_manager.cc:1428] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250112 21:02:32.245317 23034 tablet_bootstrap.cc:492] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
W20250112 21:02:32.245579 22460 catalog_manager.cc:5359] Ignoring report from unknown tablet b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:32.246131 23034 tablet_bootstrap.cc:654] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.246843 22895 tablet_service.cc:1514] Processing DeleteTablet for tablet 43b4420df3e84c1888043baa9f2dd692 with delete_type TABLET_DATA_DELETED (replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925) from {username='slave'} at 127.0.0.1:50006
W20250112 21:02:32.247447 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 43b4420df3e84c1888043baa9f2dd692 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43b4420df3e84c1888043baa9f2dd692 already in progress: creating tablet
I20250112 21:02:32.248010 22465 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_43fd2301070a49119af5f07230e04cd0" } new_table_name: "default.Table_d709c9c11351488e8a36fe79c5cc3d6b" modify_external_catalogs: true
I20250112 21:02:32.248351 23134 raft_consensus.cc:491] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.248471 23134 raft_consensus.cc:513] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.248802 23134 leader_election.cc:290] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.249169 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.249248 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.249354 22781 raft_consensus.cc:2463] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.249647 23034 tablet_bootstrap.cc:492] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.249614 22851 leader_election.cc:304] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.249722 23034 ts_tablet_manager.cc:1397] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
W20250112 21:02:32.249825 22851 leader_election.cc:343] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.249893 23036 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.249969 23036 ts_tablet_manager.cc:1397] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20250112 21:02:32.250012 23134 raft_consensus.cc:2798] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.250056 23134 raft_consensus.cc:491] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.250092 23134 raft_consensus.cc:3054] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.250154 23034 raft_consensus.cc:357] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.250243 23034 raft_consensus.cc:383] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.250274 23034 raft_consensus.cc:738] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.250383 23034 consensus_queue.cc:260] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.250416 23036 raft_consensus.cc:357] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.250506 23036 raft_consensus.cc:383] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.250532 23036 raft_consensus.cc:738] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.250631 23036 consensus_queue.cc:260] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.250876 23036 ts_tablet_manager.cc:1428] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.251039 23036 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.251000 23134 raft_consensus.cc:513] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.251286 23134 leader_election.cc:290] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.251811 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.251912 22781 raft_consensus.cc:3054] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.251966 23036 tablet_bootstrap.cc:654] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.252800 22781 raft_consensus.cc:2463] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.253422 22851 leader_election.cc:304] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.253501 23034 ts_tablet_manager.cc:1428] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20250112 21:02:32.253576 23226 raft_consensus.cc:2798] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.253646 23226 raft_consensus.cc:695] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.253664 23034 tablet_bootstrap.cc:492] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.253753 23226 consensus_queue.cc:237] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.255383 23034 tablet_bootstrap.cc:654] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.257423 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77617388a31447f196febf2980f3f410" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.258496 22463 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_63f8fa00f02e45248b19a656719cce8f [id=aa1f07977f974c958523d83489ac64bc] alter complete (version 1)
W20250112 21:02:32.258787 22851 leader_election.cc:343] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.259042 23037 tablet_bootstrap.cc:492] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.259132 23037 ts_tablet_manager.cc:1397] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.000s
I20250112 21:02:32.260321 23037 raft_consensus.cc:357] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.260445 23037 raft_consensus.cc:383] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.260493 23037 raft_consensus.cc:738] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.260609 23037 consensus_queue.cc:260] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.260959 23034 tablet_bootstrap.cc:492] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.260991 23037 ts_tablet_manager.cc:1428] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:32.261044 23034 ts_tablet_manager.cc:1397] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:32.261525 22761 tablet_service.cc:1467] Processing CreateTablet for tablet b2a945c86c4445b0bd3a111f3c3765db (DEFAULT_TABLE table=default.Table_b1ee32bb31724a41ad80a07975029bd8 [id=dd80532d65954427b62f833962aecbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.261752 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a945c86c4445b0bd3a111f3c3765db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.261982 22756 tablet_service.cc:1467] Processing CreateTablet for tablet 327bb2b15d5f4c20abbfc0b17f15763a (DEFAULT_TABLE table=default.Table_7e4925c30bba424abbd299e6bc835675 [id=7228e85e32ae4a31a2e881b1919d71d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.262077 22762 tablet_service.cc:1467] Processing CreateTablet for tablet a4314890b8e04143a3d62ce2deb57ab8 (DEFAULT_TABLE table=default.Table_f6da1e30a81d47ff8607a8fb3f1b8bb2 [id=3b551d47b1f9487e8edde224bc56a61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.262106 22753 tablet_service.cc:1467] Processing CreateTablet for tablet 48933f7bd99a4076a0b3c7118398d5d7 (DEFAULT_TABLE table=default.Table_b2bb5b185c4b4addafea721c3334ad27 [id=505836cc21b54e7b8586e459c862510e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.262189 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bb2b15d5f4c20abbfc0b17f15763a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.262296 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4314890b8e04143a3d62ce2deb57ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.262318 22759 tablet_service.cc:1467] Processing CreateTablet for tablet dacaaef9a440491aac0b5309a87b03f0 (DEFAULT_TABLE table=default.Table_7b9905591b8c411584faf5db4d1a92f3 [id=fc594576db0248068eeb58008cffaec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.262528 23037 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.263298 23037 tablet_bootstrap.cc:654] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.263568 22758 tablet_service.cc:1467] Processing CreateTablet for tablet 1256378bfe8f4872a88adcfaf91e9a8b (DEFAULT_TABLE table=default.Table_8108dc78db2345f1aef3996f97470431 [id=51738742ded648c18882353ca7ec012a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.263808 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 458d05e149184064a8fc90d2a8f671c3 (DEFAULT_TABLE table=default.Table_17179b9f156944a191777a7a68441af4 [id=152e309b5b4b4f46b32acb96d3b34ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.264036 22754 tablet_service.cc:1467] Processing CreateTablet for tablet c1feb079a0404569a181358cf54f698d (DEFAULT_TABLE table=default.Table_3da7061174aa4a1a9bb10372fa3e7bcd [id=160f5a37578b4f44a10439d5a05d7875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.264262 22755 tablet_service.cc:1467] Processing CreateTablet for tablet b028cb5715bc494486dc374b47f33605 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.264565 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 4928f2de8b3a4b2db30165b304553eac (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.264575 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacaaef9a440491aac0b5309a87b03f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:32.265264 22460 catalog_manager.cc:5359] Ignoring report from unknown tablet d19c73dce51147e29837df3b364af790
I20250112 21:02:32.265565 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1256378bfe8f4872a88adcfaf91e9a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.266402 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4928f2de8b3a4b2db30165b304553eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.268285 22895 tablet_service.cc:1467] Processing CreateTablet for tablet b2a945c86c4445b0bd3a111f3c3765db (DEFAULT_TABLE table=default.Table_b1ee32bb31724a41ad80a07975029bd8 [id=dd80532d65954427b62f833962aecbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.268494 22460 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_e0bbe825854948e092e7cd7016a76e45" } new_table_name: "default.Table_a765192b404b4d159d0a4b2ab4a19e95" modify_external_catalogs: true
I20250112 21:02:32.268560 22892 tablet_service.cc:1467] Processing CreateTablet for tablet b028cb5715bc494486dc374b47f33605 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.268711 22888 tablet_service.cc:1467] Processing CreateTablet for tablet c1feb079a0404569a181358cf54f698d (DEFAULT_TABLE table=default.Table_3da7061174aa4a1a9bb10372fa3e7bcd [id=160f5a37578b4f44a10439d5a05d7875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.268800 22897 tablet_service.cc:1467] Processing CreateTablet for tablet 458d05e149184064a8fc90d2a8f671c3 (DEFAULT_TABLE table=default.Table_17179b9f156944a191777a7a68441af4 [id=152e309b5b4b4f46b32acb96d3b34ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.268922 22887 tablet_service.cc:1467] Processing CreateTablet for tablet 1256378bfe8f4872a88adcfaf91e9a8b (DEFAULT_TABLE table=default.Table_8108dc78db2345f1aef3996f97470431 [id=51738742ded648c18882353ca7ec012a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269019 22882 tablet_service.cc:1467] Processing CreateTablet for tablet a4314890b8e04143a3d62ce2deb57ab8 (DEFAULT_TABLE table=default.Table_f6da1e30a81d47ff8607a8fb3f1b8bb2 [id=3b551d47b1f9487e8edde224bc56a61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269068 22891 tablet_service.cc:1467] Processing CreateTablet for tablet d4ac0afdf7ee4ca894d9c7375e5caef8 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269131 23134 raft_consensus.cc:491] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.269214 23134 raft_consensus.cc:513] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.269259 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458d05e149184064a8fc90d2a8f671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.269321 22886 tablet_service.cc:1467] Processing CreateTablet for tablet dacaaef9a440491aac0b5309a87b03f0 (DEFAULT_TABLE table=default.Table_7b9905591b8c411584faf5db4d1a92f3 [id=fc594576db0248068eeb58008cffaec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269354 22884 tablet_service.cc:1467] Processing CreateTablet for tablet 48933f7bd99a4076a0b3c7118398d5d7 (DEFAULT_TABLE table=default.Table_b2bb5b185c4b4addafea721c3334ad27 [id=505836cc21b54e7b8586e459c862510e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269541 23134 leader_election.cc:290] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.269618 22883 tablet_service.cc:1467] Processing CreateTablet for tablet 327bb2b15d5f4c20abbfc0b17f15763a (DEFAULT_TABLE table=default.Table_7e4925c30bba424abbd299e6bc835675 [id=7228e85e32ae4a31a2e881b1919d71d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.269833 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 4928f2de8b3a4b2db30165b304553eac (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.270083 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 498bf4ae40274179bb0ef3e1f66c1578 (DEFAULT_TABLE table=default.Table_09ca0502b0094be69211b7297b83e76b [id=99130c9fdbc247f6b57430bc03854b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.268558 22895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a945c86c4445b0bd3a111f3c3765db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.271184 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498bf4ae40274179bb0ef3e1f66c1578. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.271324 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1256378bfe8f4872a88adcfaf91e9a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.271421 22891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac0afdf7ee4ca894d9c7375e5caef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.273165 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458d05e149184064a8fc90d2a8f671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.273473 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4928f2de8b3a4b2db30165b304553eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.274914 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028cb5715bc494486dc374b47f33605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.275173 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1feb079a0404569a181358cf54f698d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.276789 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bb2b15d5f4c20abbfc0b17f15763a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.277798 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.277904 22781 raft_consensus.cc:2463] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.278160 22851 leader_election.cc:304] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.278223 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48933f7bd99a4076a0b3c7118398d5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.278319 23134 raft_consensus.cc:2798] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.278373 23134 raft_consensus.cc:491] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.278410 23134 raft_consensus.cc:3054] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.278467 22758 tablet_service.cc:1467] Processing CreateTablet for tablet d4ac0afdf7ee4ca894d9c7375e5caef8 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.278684 22758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac0afdf7ee4ca894d9c7375e5caef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.279186 23134 raft_consensus.cc:513] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.279520 23134 leader_election.cc:290] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.279811 22617 tablet_service.cc:1467] Processing CreateTablet for tablet b028cb5715bc494486dc374b47f33605 (DEFAULT_TABLE table=default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.279947 22615 tablet_service.cc:1467] Processing CreateTablet for tablet a4314890b8e04143a3d62ce2deb57ab8 (DEFAULT_TABLE table=default.Table_f6da1e30a81d47ff8607a8fb3f1b8bb2 [id=3b551d47b1f9487e8edde224bc56a61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.279989 22614 tablet_service.cc:1467] Processing CreateTablet for tablet b2a945c86c4445b0bd3a111f3c3765db (DEFAULT_TABLE table=default.Table_b1ee32bb31724a41ad80a07975029bd8 [id=dd80532d65954427b62f833962aecbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.279811 22616 tablet_service.cc:1467] Processing CreateTablet for tablet c1feb079a0404569a181358cf54f698d (DEFAULT_TABLE table=default.Table_3da7061174aa4a1a9bb10372fa3e7bcd [id=160f5a37578b4f44a10439d5a05d7875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.280373 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 1256378bfe8f4872a88adcfaf91e9a8b (DEFAULT_TABLE table=default.Table_8108dc78db2345f1aef3996f97470431 [id=51738742ded648c18882353ca7ec012a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.280567 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.280586 22619 tablet_service.cc:1467] Processing CreateTablet for tablet 327bb2b15d5f4c20abbfc0b17f15763a (DEFAULT_TABLE table=default.Table_7e4925c30bba424abbd299e6bc835675 [id=7228e85e32ae4a31a2e881b1919d71d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.280673 22647 raft_consensus.cc:2463] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.280719 22626 tablet_service.cc:1467] Processing CreateTablet for tablet 458d05e149184064a8fc90d2a8f671c3 (DEFAULT_TABLE table=default.Table_17179b9f156944a191777a7a68441af4 [id=152e309b5b4b4f46b32acb96d3b34ae0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.281018 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 48933f7bd99a4076a0b3c7118398d5d7 (DEFAULT_TABLE table=default.Table_b2bb5b185c4b4addafea721c3334ad27 [id=505836cc21b54e7b8586e459c862510e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.281219 22618 tablet_service.cc:1467] Processing CreateTablet for tablet 498bf4ae40274179bb0ef3e1f66c1578 (DEFAULT_TABLE table=default.Table_09ca0502b0094be69211b7297b83e76b [id=99130c9fdbc247f6b57430bc03854b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.281318 22613 tablet_service.cc:1467] Processing CreateTablet for tablet 4928f2de8b3a4b2db30165b304553eac (DEFAULT_TABLE table=default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.281497 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.281584 22647 raft_consensus.cc:3054] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.281627 22621 tablet_service.cc:1467] Processing CreateTablet for tablet dacaaef9a440491aac0b5309a87b03f0 (DEFAULT_TABLE table=default.Table_7b9905591b8c411584faf5db4d1a92f3 [id=fc594576db0248068eeb58008cffaec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.281924 22625 tablet_service.cc:1467] Processing CreateTablet for tablet d4ac0afdf7ee4ca894d9c7375e5caef8 (DEFAULT_TABLE table=default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.282223 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1feb079a0404569a181358cf54f698d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.282503 22647 raft_consensus.cc:2463] T 65b0da9ee2d545e8acef16ad06ac1966 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.282771 22851 leader_election.cc:304] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.283141 23226 raft_consensus.cc:2798] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.283218 23226 raft_consensus.cc:695] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.283335 23226 consensus_queue.cc:237] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.283788 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65b0da9ee2d545e8acef16ad06ac1966" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.283877 22781 raft_consensus.cc:3054] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.284502 22917 raft_consensus.cc:1270] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Refusing update from remote peer 0b63e675bcb141f3a7887ea5ef9ed2df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.284735 22781 raft_consensus.cc:2463] T 65b0da9ee2d545e8acef16ad06ac1966 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
W20250112 21:02:32.285163 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet f2b088a5d5eb423e87d1542eaded5cd7
I20250112 21:02:32.286407 23460 consensus_queue.cc:1035] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.287240 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4314890b8e04143a3d62ce2deb57ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.287989 23037 tablet_bootstrap.cc:492] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.288065 23037 ts_tablet_manager.cc:1397] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
W20250112 21:02:32.288277 22715 consensus_peers.cc:487] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df -> Peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Couldn't send request to peer d8faec3969b64c33a4bf9aba509785ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:32.288532 23037 raft_consensus.cc:357] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.288625 23037 raft_consensus.cc:383] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.288653 23037 raft_consensus.cc:738] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.288766 23037 consensus_queue.cc:260] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.289044 23037 ts_tablet_manager.cc:1428] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.289055 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 498bf4ae40274179bb0ef3e1f66c1578 (DEFAULT_TABLE table=default.Table_09ca0502b0094be69211b7297b83e76b [id=99130c9fdbc247f6b57430bc03854b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.289268 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacaaef9a440491aac0b5309a87b03f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.289265 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498bf4ae40274179bb0ef3e1f66c1578. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.289412 23037 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
W20250112 21:02:32.290192 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:32.280046 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028cb5715bc494486dc374b47f33605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.291142 22615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4314890b8e04143a3d62ce2deb57ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.291291 22616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1feb079a0404569a181358cf54f698d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.291496 22619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327bb2b15d5f4c20abbfc0b17f15763a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.292493 22625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ac0afdf7ee4ca894d9c7375e5caef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.293454 22626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 458d05e149184064a8fc90d2a8f671c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.294273 22613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4928f2de8b3a4b2db30165b304553eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.294574 23037 tablet_bootstrap.cc:654] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.295282 22463 master_service.cc:946] ReplaceTablet: received request to replace tablet 4928f2de8b3a4b2db30165b304553eac from {username='slave'} at 127.0.0.1:39888
I20250112 21:02:32.296039 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48933f7bd99a4076a0b3c7118398d5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.296365 23406 tablet.cc:1721] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250112 21:02:32.297405 22618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498bf4ae40274179bb0ef3e1f66c1578. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.297766 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacaaef9a440491aac0b5309a87b03f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.300609 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1256378bfe8f4872a88adcfaf91e9a8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:32.300653 22461 catalog_manager.cc:5359] Ignoring report from unknown tablet dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:32.302459 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a945c86c4445b0bd3a111f3c3765db. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.303555 23084 tablet.cc:1721] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250112 21:02:32.306835 23037 tablet_bootstrap.cc:492] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.306907 23037 ts_tablet_manager.cc:1397] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20250112 21:02:32.307325 23037 raft_consensus.cc:357] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.307413 23037 raft_consensus.cc:383] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.307441 23037 raft_consensus.cc:738] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.307560 23037 consensus_queue.cc:260] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.308056 23037 ts_tablet_manager.cc:1428] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.308339 23037 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.308987 22757 tablet_service.cc:1514] Processing DeleteTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb with delete_type TABLET_DATA_DELETED (replaced by tablet feed94806b85451e98bc1700aa3aa7be) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.309024 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028cb5715bc494486dc374b47f33605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.309244 23037 tablet_bootstrap.cc:654] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.309442 23036 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.309528 23036 ts_tablet_manager.cc:1397] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.001s
I20250112 21:02:32.309947 23036 raft_consensus.cc:357] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.310039 23036 raft_consensus.cc:383] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.310070 23036 raft_consensus.cc:738] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.310175 23036 consensus_queue.cc:260] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.310438 23036 ts_tablet_manager.cc:1428] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.311000 23036 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.311146 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48933f7bd99a4076a0b3c7118398d5d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.311862 22461 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.312006 23036 tablet_bootstrap.cc:654] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:32.313824 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 79963c1d3d8e45e9b94908efd6487cdb because the tablet was not found. No further retry: Not found: Tablet not found: 79963c1d3d8e45e9b94908efd6487cdb
I20250112 21:02:32.314273 23406 tablet.cc:1716] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Skipping requested alter to schema version 5, tablet already version 5
I20250112 21:02:32.314842 22917 raft_consensus.cc:3054] T 92cbead1e7a04ee58645c8a03fbfd71e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.316906 22461 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.317538 23084 tablet.cc:1716] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Skipping requested alter to schema version 5, tablet already version 5
I20250112 21:02:32.318080 23460 consensus_queue.cc:1035] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.318162 23034 raft_consensus.cc:357] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.318238 23034 raft_consensus.cc:383] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.318445 23034 raft_consensus.cc:738] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.318620 23034 consensus_queue.cc:260] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.320271 23034 ts_tablet_manager.cc:1428] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.059s user 0.001s sys 0.000s
I20250112 21:02:32.320497 23034 tablet_bootstrap.cc:492] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.321589 23034 tablet_bootstrap.cc:654] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.321959 22465 catalog_manager.cc:5526] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:32.322163 22465 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.322521 23034 tablet_bootstrap.cc:492] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.322602 23034 ts_tablet_manager.cc:1397] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
W20250112 21:02:32.322837 22460 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00a6b17fc93f437b854bdef9ae47bab8 consensus state has no leader
I20250112 21:02:32.323024 23034 raft_consensus.cc:357] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.323084 22458 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_d709c9c11351488e8a36fe79c5cc3d6b [id=83aa4d12b5d24a628351eb0a6b975cb7] alter complete (version 5)
I20250112 21:02:32.323113 23034 raft_consensus.cc:383] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.323143 23034 raft_consensus.cc:738] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.323256 23034 consensus_queue.cc:260] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.323529 23034 ts_tablet_manager.cc:1428] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.323685 23034 tablet_bootstrap.cc:492] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.325305 23065 consensus_queue.cc:1035] T 92cbead1e7a04ee58645c8a03fbfd71e P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.327076 23036 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.327160 23036 ts_tablet_manager.cc:1397] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250112 21:02:32.327608 23036 raft_consensus.cc:357] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.327720 23036 raft_consensus.cc:383] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.327759 23036 raft_consensus.cc:738] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.327878 23036 consensus_queue.cc:260] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.328153 23036 ts_tablet_manager.cc:1428] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.328325 23036 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.328866 23460 raft_consensus.cc:491] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.328950 23460 raft_consensus.cc:513] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.329306 23460 leader_election.cc:290] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.329397 23036 tablet_bootstrap.cc:654] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.329595 23037 tablet_bootstrap.cc:492] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.329680 23037 ts_tablet_manager.cc:1397] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20250112 21:02:32.330142 23037 raft_consensus.cc:357] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.330240 23037 raft_consensus.cc:383] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.330269 23037 raft_consensus.cc:738] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.330379 23037 consensus_queue.cc:260] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.330480 22646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.330667 23037 ts_tablet_manager.cc:1428] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.330827 23037 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
W20250112 21:02:32.330804 22715 leader_election.cc:343] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.331708 23037 tablet_bootstrap.cc:654] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.331797 23034 tablet_bootstrap.cc:654] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.332621 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:32.332968 22717 leader_election.cc:343] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.333034 22717 leader_election.cc:304] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.333149 23460 raft_consensus.cc:2743] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250112 21:02:32.334442 22463 sys_catalog.cc:609] row 1: Not found: key not found
W20250112 21:02:32.334570 22463 catalog_manager.cc:6561] Corruption: an error occurred while writing to the sys-catalog: failed to write one or more rows
I20250112 21:02:32.334833 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 43b4420df3e84c1888043baa9f2dd692 with delete_type TABLET_DATA_DELETED (replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.334985 23040 tablet_replica.cc:331] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:32.335088 23040 raft_consensus.cc:2238] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.335171 23040 raft_consensus.cc:2267] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.336220 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet 43b4420df3e84c1888043baa9f2dd692 with delete_type TABLET_DATA_DELETED (replaced by tablet c0e676bf33c4460ebff2b9fea2cc0925) from {username='slave'} at 127.0.0.1:50006
F20250112 21:02:32.336498 22998 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Corruption: an error occurred while writing to the sys-catalog: failed to write one or more rows
I20250112 21:02:32.336547 23038 tablet_replica.cc:331] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.336661 23038 raft_consensus.cc:2238] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.336689 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bb4c46b3766b4fdcac393f9680d45141" } modify_external_catalogs: true
I20250112 21:02:32.336755 23038 raft_consensus.cc:2267] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.336794 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_bb4c46b3766b4fdcac393f9680d45141" } modify_external_catalogs: true
*** Check failure stack trace: ***
*** Aborted at 1736715752 (unix time) try "date -d @1736715752" if you are using GNU date ***
I20250112 21:02:32.337186 23038 ts_tablet_manager.cc:1905] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.337461 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3da7061174aa4a1a9bb10372fa3e7bcd" } modify_external_catalogs: true
I20250112 21:02:32.337540 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_3da7061174aa4a1a9bb10372fa3e7bcd" } modify_external_catalogs: true
I20250112 21:02:32.339182 23460 raft_consensus.cc:491] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.339260 23460 raft_consensus.cc:513] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.339365 23038 ts_tablet_manager.cc:1918] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.339422 23038 log.cc:1198] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/43b4420df3e84c1888043baa9f2dd692
I20250112 21:02:32.339558 23460 leader_election.cc:290] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.339614 23038 ts_tablet_manager.cc:1939] T 43b4420df3e84c1888043baa9f2dd692 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.339807 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f944f0d5e5994fd5abb2ed2c991a3eef" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.339905 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f944f0d5e5994fd5abb2ed2c991a3eef" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.340121 22717 leader_election.cc:343] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.340188 22715 leader_election.cc:343] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.340256 22715 leader_election.cc:304] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.340365 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 43b4420df3e84c1888043baa9f2dd692 (table default.Table_bb4c46b3766b4fdcac393f9680d45141 [id=ed88f4f9684a4c65bd9383155c4690b7]) successfully deleted
PC: @ 0x0 (unknown)
I20250112 21:02:32.340447 23460 raft_consensus.cc:2743] T f944f0d5e5994fd5abb2ed2c991a3eef P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
*** SIGABRT (@0x3e80000570b) received by PID 22283 (TID 0x7ff11e0b3700) from PID 22283; stack trace: ***
@ 0x7ff13bd30980 (unknown) at ??:0
@ 0x7ff13994dfb7 gsignal at ??:0
I20250112 21:02:32.345978 22647 raft_consensus.cc:3054] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.346635 23040 ts_tablet_manager.cc:1905] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.346871 22465 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet c0e676bf33c4460ebff2b9fea2cc0925
@ 0x7ff13994f921 abort at ??:0
I20250112 21:02:32.348143 23497 tablet.cc:1721] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250112 21:02:32.348691 23065 raft_consensus.cc:491] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.348730 23040 ts_tablet_manager.cc:1918] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.348793 23040 log.cc:1198] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/43b4420df3e84c1888043baa9f2dd692
I20250112 21:02:32.348766 23065 raft_consensus.cc:513] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.348977 23040 ts_tablet_manager.cc:1939] T 43b4420df3e84c1888043baa9f2dd692 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:32.349082 23065 leader_election.cc:290] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
@ 0x7ff13a7b8dcd google::LogMessage::Fail() at ??:0
I20250112 21:02:32.349840 22645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e83f9dc722400bbbd3114156318ac4" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
@ 0x7ff13a7bcb93 google::LogMessage::SendToLog() at ??:0
W20250112 21:02:32.352365 22715 leader_election.cc:343] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.352800 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e83f9dc722400bbbd3114156318ac4" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.352917 22917 raft_consensus.cc:2463] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:32.353199 22717 leader_election.cc:304] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
@ 0x7ff13a7b87cc google::LogMessage::Flush() at ??:0
I20250112 21:02:32.353453 23065 raft_consensus.cc:2798] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.353503 23065 raft_consensus.cc:491] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.353549 23065 raft_consensus.cc:3054] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.354441 23065 raft_consensus.cc:513] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.354777 23065 leader_election.cc:290] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.354982 23036 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.355062 23036 ts_tablet_manager.cc:1397] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
@ 0x7ff13a7b9f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20250112 21:02:32.355172 22645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e83f9dc722400bbbd3114156318ac4" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
@ 0x560f26f3ba46 kudu::MasterStressTest::ReplaceTabletThread() at ??:0
@ 0x560f26f4d6a6 std::__invoke_impl<>() at ??:0
I20250112 21:02:32.355544 23036 raft_consensus.cc:357] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.355635 23036 raft_consensus.cc:383] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.355665 23036 raft_consensus.cc:738] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
@ 0x560f26f4b3e2 std::__invoke<>() at ??:0
I20250112 21:02:32.355773 23036 consensus_queue.cc:260] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
@ 0x560f26f52a33 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
I20250112 21:02:32.356034 23036 ts_tablet_manager.cc:1428] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
@ 0x560f26f51a37 std::thread::_Invoker<>::operator()() at ??:0
I20250112 21:02:32.356195 23036 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.356261 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet c1feb079a0404569a181358cf54f698d
W20250112 21:02:32.357270 22715 leader_election.cc:343] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.357781 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet c1feb079a0404569a181358cf54f698d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.358407 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 458bbc607af0400d93fe7990999d90b9 (table default.Table_4ef72badd3184cdc81f8e4e2062bbb45 [id=01456c35f2ab4b4791ff53ac176be72e]). Expected version 3 got 0
I20250112 21:02:32.358554 23034 tablet_bootstrap.cc:492] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.358636 23034 ts_tablet_manager.cc:1397] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.000s
I20250112 21:02:32.359067 23034 raft_consensus.cc:357] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.359158 23034 raft_consensus.cc:383] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.359187 23034 raft_consensus.cc:738] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
W20250112 21:02:32.359215 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet c1feb079a0404569a181358cf54f698d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1feb079a0404569a181358cf54f698d already in progress: creating tablet
I20250112 21:02:32.359300 23034 consensus_queue.cc:260] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.359575 23034 ts_tablet_manager.cc:1428] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.359753 23034 tablet_bootstrap.cc:492] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
@ 0x560f26f507b4 std::thread::_State_impl<>::_M_run() at ??:0
I20250112 21:02:32.360368 22753 tablet_service.cc:1514] Processing DeleteTablet for tablet c1feb079a0404569a181358cf54f698d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.360692 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e83f9dc722400bbbd3114156318ac4" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:32.360783 22917 raft_consensus.cc:3054] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:32.361472 22450 catalog_manager.cc:4852] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet c1feb079a0404569a181358cf54f698d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1feb079a0404569a181358cf54f698d already in progress: creating tablet
I20250112 21:02:32.361624 23034 tablet_bootstrap.cc:654] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.361663 22917 raft_consensus.cc:2463] T 78e83f9dc722400bbbd3114156318ac4 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:32.364318 22717 leader_election.cc:304] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.364527 23460 raft_consensus.cc:2798] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.364591 23460 raft_consensus.cc:695] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:32.364708 23460 consensus_queue.cc:237] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.367223 22617 tablet_service.cc:1467] Processing CreateTablet for tablet ae6e6137611045bda64ea4e0bb0fc51b (DEFAULT_TABLE table=default.Table_6c9a7cd845a74835ba803e6d3d876b0b [id=fe48b3fe11c74999bd2bcd77fb932946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.367487 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6e6137611045bda64ea4e0bb0fc51b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff139fd56df (unknown) at ??:0
I20250112 21:02:32.368332 22463 catalog_manager.cc:5526] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.368618 22614 tablet_service.cc:1467] Processing CreateTablet for tablet feed94806b85451e98bc1700aa3aa7be (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.368695 22755 tablet_service.cc:1467] Processing CreateTablet for tablet feed94806b85451e98bc1700aa3aa7be (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.368834 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed94806b85451e98bc1700aa3aa7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.368925 22755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed94806b85451e98bc1700aa3aa7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.370913 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 77a684da69aa4a99acc9a79456fb6526 (DEFAULT_TABLE table=default.Table_6df6d7e9961f4c82b5c3606a93d75a1c [id=07f8690ea811420ab190001108ba9f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.371124 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a684da69aa4a99acc9a79456fb6526. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.371546 22753 tablet_service.cc:1467] Processing CreateTablet for tablet ae6e6137611045bda64ea4e0bb0fc51b (DEFAULT_TABLE table=default.Table_6c9a7cd845a74835ba803e6d3d876b0b [id=fe48b3fe11c74999bd2bcd77fb932946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.371749 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6e6137611045bda64ea4e0bb0fc51b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff13bd256db start_thread at ??:0
I20250112 21:02:32.372789 23497 tablet.cc:1716] T 458bbc607af0400d93fe7990999d90b9 P d8faec3969b64c33a4bf9aba509785ea: Skipping requested alter to schema version 3, tablet already version 3
I20250112 21:02:32.372933 23034 tablet_bootstrap.cc:492] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.373005 23034 ts_tablet_manager.cc:1397] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20250112 21:02:32.373196 22612 tablet_service.cc:1467] Processing CreateTablet for tablet 77a684da69aa4a99acc9a79456fb6526 (DEFAULT_TABLE table=default.Table_6df6d7e9961f4c82b5c3606a93d75a1c [id=07f8690ea811420ab190001108ba9f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.373394 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a684da69aa4a99acc9a79456fb6526. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.373464 23034 raft_consensus.cc:357] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.373549 23034 raft_consensus.cc:383] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.373579 23034 raft_consensus.cc:738] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.373703 23034 consensus_queue.cc:260] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.373947 23034 ts_tablet_manager.cc:1428] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250112 21:02:32.374092 23034 tablet_bootstrap.cc:492] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.374991 23034 tablet_bootstrap.cc:654] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.372990 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c50b95d782e420a8e32acf58f95d85a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.375803 23036 tablet_bootstrap.cc:654] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.378816 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet c1feb079a0404569a181358cf54f698d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.379000 23226 raft_consensus.cc:491] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.379077 23226 raft_consensus.cc:513] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.379266 22460 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c5f83956bcdb4c078af6d6f0370a5d3e" } modify_external_catalogs: true
I20250112 21:02:32.379364 22460 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_c5f83956bcdb4c078af6d6f0370a5d3e" } modify_external_catalogs: true
I20250112 21:02:32.379364 22882 tablet_service.cc:1467] Processing CreateTablet for tablet ae6e6137611045bda64ea4e0bb0fc51b (DEFAULT_TABLE table=default.Table_6c9a7cd845a74835ba803e6d3d876b0b [id=fe48b3fe11c74999bd2bcd77fb932946]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.379426 23226 leader_election.cc:290] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.379587 22882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae6e6137611045bda64ea4e0bb0fc51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.379855 23039 tablet_replica.cc:331] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.379971 23039 raft_consensus.cc:2238] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.380051 23039 raft_consensus.cc:2267] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.380277 22461 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_1233d604802d42199b1077f9349f52a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.380625 22461 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1233d604802d42199b1077f9349f52a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.380604 22465 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d709c9c11351488e8a36fe79c5cc3d6b" } modify_external_catalogs: true
I20250112 21:02:32.380684 22465 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39888:
table { table_name: "default.Table_d709c9c11351488e8a36fe79c5cc3d6b" } modify_external_catalogs: true
W20250112 21:02:32.381764 22452 catalog_manager.cc:4852] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet c1feb079a0404569a181358cf54f698d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1feb079a0404569a181358cf54f698d already in progress: creating tablet
I20250112 21:02:32.382002 22457 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_ce5b3cd00a3d41f5bbc3309443307021"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.382287 22457 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce5b3cd00a3d41f5bbc3309443307021 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.382676 23037 tablet_bootstrap.cc:492] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.382745 23037 ts_tablet_manager.cc:1397] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20250112 21:02:32.382925 22462 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_1f10f6be10d94c50945e9a34000ddb76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:32.383136 23037 raft_consensus.cc:357] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
W20250112 21:02:32.383185 22462 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f10f6be10d94c50945e9a34000ddb76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.383222 23037 raft_consensus.cc:383] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.383248 23037 raft_consensus.cc:738] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.383352 23037 consensus_queue.cc:260] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.383597 23037 ts_tablet_manager.cc:1428] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.383750 23037 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.383803 22466 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_2a41ff6ff7fd45b39a67f64a078b15bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.384049 22466 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a41ff6ff7fd45b39a67f64a078b15bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.385149 22894 tablet_service.cc:1467] Processing CreateTablet for tablet 77a684da69aa4a99acc9a79456fb6526 (DEFAULT_TABLE table=default.Table_6df6d7e9961f4c82b5c3606a93d75a1c [id=07f8690ea811420ab190001108ba9f8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.385355 22894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a684da69aa4a99acc9a79456fb6526. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.385767 22917 raft_consensus.cc:3054] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:32.386757 22851 leader_election.cc:343] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 1ded0955d63e42d78453ee94a59d413d
I20250112 21:02:32.387116 23065 consensus_queue.cc:1035] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.387369 22464 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_4922beba4a694f31b3efe0e60618b13a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250112 21:02:32.387637 22464 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4922beba4a694f31b3efe0e60618b13a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.388257 22459 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39888:
name: "default.Table_e4e402fbe40b420981cd428247f2b996"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250112 21:02:32.388302 22886 tablet_service.cc:1467] Processing CreateTablet for tablet feed94806b85451e98bc1700aa3aa7be (DEFAULT_TABLE table=default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.388533 22886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feed94806b85451e98bc1700aa3aa7be. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:32.388521 22459 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4e402fbe40b420981cd428247f2b996 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250112 21:02:32.391368 23039 ts_tablet_manager.cc:1905] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250112 21:02:32.392557 22851 leader_election.cc:343] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Not found: Tablet not found: 1ded0955d63e42d78453ee94a59d413d
I20250112 21:02:32.392625 22851 leader_election.cc:304] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.392803 23226 raft_consensus.cc:2743] T 1ded0955d63e42d78453ee94a59d413d P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.393204 23226 raft_consensus.cc:491] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.393280 23226 raft_consensus.cc:513] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.393590 23226 leader_election.cc:290] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.394441 23034 tablet_bootstrap.cc:492] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.394519 23034 ts_tablet_manager.cc:1397] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20250112 21:02:32.394964 23034 raft_consensus.cc:357] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.395056 23034 raft_consensus.cc:383] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.395085 23034 raft_consensus.cc:738] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.395196 23034 consensus_queue.cc:260] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.395450 23034 ts_tablet_manager.cc:1428] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.395642 23034 tablet_bootstrap.cc:492] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.395851 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.395947 22781 raft_consensus.cc:2463] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.396204 22851 leader_election.cc:304] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.396421 23226 raft_consensus.cc:2798] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.396466 23226 raft_consensus.cc:491] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.396502 23226 raft_consensus.cc:3054] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.397382 23226 raft_consensus.cc:513] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.397693 23226 leader_election.cc:290] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.397740 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.397886 22647 raft_consensus.cc:2463] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.398097 23034 tablet_bootstrap.cc:654] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
@ 0x7ff139a3071f clone at ??:0
I20250112 21:02:32.398937 23039 ts_tablet_manager.cc:1918] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.398999 23039 log.cc:1198] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/0c50b95d782e420a8e32acf58f95d85a
I20250112 21:02:32.399219 23036 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.399189 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.399308 23036 ts_tablet_manager.cc:1397] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20250112 21:02:32.399302 22781 raft_consensus.cc:3054] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.399721 23037 tablet_bootstrap.cc:654] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.399736 23036 raft_consensus.cc:357] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.399819 23036 raft_consensus.cc:383] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.399850 23036 raft_consensus.cc:738] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.399948 23036 consensus_queue.cc:260] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.400171 22781 raft_consensus.cc:2463] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.400226 23036 ts_tablet_manager.cc:1428] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.400393 23036 tablet_bootstrap.cc:492] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.400458 22851 leader_election.cc:304] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.400660 23134 raft_consensus.cc:2798] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.400722 23134 raft_consensus.cc:695] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.400839 23134 consensus_queue.cc:237] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.401655 23036 tablet_bootstrap.cc:654] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.402343 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4598f42f64b4354af0cfb53826d59e3" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.402447 22647 raft_consensus.cc:3054] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.403054 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 55779970251c4f819e1e3405de0bc30b (table default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]). Expected version 3 got 0
I20250112 21:02:32.403203 22458 catalog_manager.cc:5526] T 78e83f9dc722400bbbd3114156318ac4 P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } }
I20250112 21:02:32.403357 22647 raft_consensus.cc:2463] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.408120 23037 tablet_bootstrap.cc:492] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.408201 23037 ts_tablet_manager.cc:1397] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20250112 21:02:32.408699 23037 raft_consensus.cc:357] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.408792 23037 raft_consensus.cc:383] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.408821 23037 raft_consensus.cc:738] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.408926 23037 consensus_queue.cc:260] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.409184 23037 ts_tablet_manager.cc:1428] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.409395 23037 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.410338 23037 tablet_bootstrap.cc:654] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.399195 23039 ts_tablet_manager.cc:1939] T 0c50b95d782e420a8e32acf58f95d85a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.415654 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 0c50b95d782e420a8e32acf58f95d85a (table default.Table_97936dd45d9b496cbbd47d899dfa6433 [id=2bf2e96a3eb84993826a17d1616421b7]) successfully deleted
I20250112 21:02:32.417131 22460 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.417237 23082 consensus_queue.cc:1035] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.418138 22460 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e4598f42f64b4354af0cfb53826d59e3 (table default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6]). Expected version 1 got 0
I20250112 21:02:32.418752 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.418905 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.419050 23040 tablet_replica.cc:331] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:32.419165 23040 raft_consensus.cc:2238] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.419260 23040 raft_consensus.cc:2267] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.420866 22886 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.421025 23038 tablet_replica.cc:331] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.421128 23038 raft_consensus.cc:2238] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.421224 23038 raft_consensus.cc:2267] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.421757 23038 ts_tablet_manager.cc:1905] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.423265 22466 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e4598f42f64b4354af0cfb53826d59e3 (table default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6]). Expected version 1 got 0
W20250112 21:02:32.423687 23536 consensus_queue.cc:1159] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d8faec3969b64c33a4bf9aba509785ea" status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20250112 21:02:32.423856 23038 ts_tablet_manager.cc:1918] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:32.423914 23038 log.cc:1198] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.424122 23038 ts_tablet_manager.cc:1939] T 6cbf428b373d462ca89bd39795c6ed31 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.424158 22465 catalog_manager.cc:5813] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: Sending DeleteTablet for 3 replicas of tablet 56914e0635284561adb64897a0dfe37c
I20250112 21:02:32.424324 23226 raft_consensus.cc:491] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.424386 23226 raft_consensus.cc:513] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.424646 23040 ts_tablet_manager.cc:1905] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.424749 23226 leader_election.cc:290] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.425940 22756 tablet_service.cc:1514] Processing DeleteTablet for tablet 56914e0635284561adb64897a0dfe37c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.426100 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 56914e0635284561adb64897a0dfe37c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.426769 23040 ts_tablet_manager.cc:1918] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:32.426831 23040 log.cc:1198] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.427042 23040 ts_tablet_manager.cc:1939] T 6cbf428b373d462ca89bd39795c6ed31 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:32.427706 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.427984 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 6cbf428b373d462ca89bd39795c6ed31 (table default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]) successfully deleted
W20250112 21:02:32.428041 22851 leader_election.cc:343] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.428140 22450 catalog_manager.cc:4852] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): delete failed for tablet 56914e0635284561adb64897a0dfe37c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56914e0635284561adb64897a0dfe37c already in progress: creating tablet
W20250112 21:02:32.428731 22463 catalog_manager.cc:5359] Ignoring report from unknown tablet df5959512e2f4b23a8c275653cbce77c
I20250112 21:02:32.428714 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.428848 22781 raft_consensus.cc:2463] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.428896 23036 tablet_bootstrap.cc:492] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.428966 23036 ts_tablet_manager.cc:1397] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20250112 21:02:32.429136 22851 leader_election.cc:304] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.429379 23226 raft_consensus.cc:2798] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.429441 23226 raft_consensus.cc:491] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.429476 23226 raft_consensus.cc:3054] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.430343 23039 tablet_replica.cc:331] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.430372 23226 raft_consensus.cc:513] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.430472 23039 raft_consensus.cc:2238] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:32.430687 23226 leader_election.cc:290] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.430682 23039 raft_consensus.cc:2267] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.431221 23039 ts_tablet_manager.cc:1905] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.429394 23036 raft_consensus.cc:357] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.431313 23036 raft_consensus.cc:383] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.431340 23036 raft_consensus.cc:738] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.431450 23036 consensus_queue.cc:260] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.431699 23036 ts_tablet_manager.cc:1428] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250112 21:02:32.431869 23036 tablet_bootstrap.cc:492] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.432796 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 6cbf428b373d462ca89bd39795c6ed31 (table default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]) successfully deleted
I20250112 21:02:32.440905 22463 catalog_manager.cc:5526] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3423673c659e4427958b13fc9eaa714d (127.21.194.195). New cstate: current_term: 1 leader_uuid: "3423673c659e4427958b13fc9eaa714d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.435544 23039 ts_tablet_manager.cc:1918] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250112 21:02:32.462790 22463 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet e4598f42f64b4354af0cfb53826d59e3 (table default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6]). Expected version 1 got 0
I20250112 21:02:32.462839 23039 log.cc:1198] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.463109 23039 ts_tablet_manager.cc:1939] T 6cbf428b373d462ca89bd39795c6ed31 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.463757 23039 tablet_replica.cc:331] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.463884 23039 raft_consensus.cc:2238] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Raft consensus shutting down.
I20250112 21:02:32.464082 23039 raft_consensus.cc:2267] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.440810 23034 tablet_bootstrap.cc:492] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.464262 23034 ts_tablet_manager.cc:1397] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.000s
I20250112 21:02:32.441143 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.464702 22781 raft_consensus.cc:3054] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.464763 23034 raft_consensus.cc:357] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.464851 23034 raft_consensus.cc:383] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.464879 23034 raft_consensus.cc:738] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.466573 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 6cbf428b373d462ca89bd39795c6ed31 (table default.Table_c5f83956bcdb4c078af6d6f0370a5d3e [id=5f88da1b292a47c38c0b43ae8bfd3e7a]) successfully deleted
I20250112 21:02:32.465013 23034 consensus_queue.cc:260] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.488210 22754 tablet_service.cc:1467] Processing CreateTablet for tablet efe46b386ae744a299ff049e8dae21e6 (DEFAULT_TABLE table=default.Table_ce5b3cd00a3d41f5bbc3309443307021 [id=825fe3188fc44127a33e4a2dda3ce771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.488369 22758 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e6369517eed414295e2b23769bb5cf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.488461 23034 ts_tablet_manager.cc:1428] T 341765719b0d42168aafad19e5b4cc61 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
I20250112 21:02:32.488548 22754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe46b386ae744a299ff049e8dae21e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.488683 23034 tablet_bootstrap.cc:492] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.489037 22760 tablet_service.cc:1467] Processing CreateTablet for tablet 704acdb3f2a64480abc8e6c9ecee3d4f (DEFAULT_TABLE table=default.Table_1233d604802d42199b1077f9349f52a0 [id=84258ef784914cafa58fadcaca594d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.489130 22762 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5 (DEFAULT_TABLE table=default.Table_1f10f6be10d94c50945e9a34000ddb76 [id=3a9ebe503f364ad68555a299e53d6b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.489248 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704acdb3f2a64480abc8e6c9ecee3d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.489356 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.489638 23034 tablet_bootstrap.cc:654] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.432832 23036 tablet_bootstrap.cc:654] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.465682 22781 raft_consensus.cc:2463] T df5959512e2f4b23a8c275653cbce77c P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.458369 23082 raft_consensus.cc:491] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.433562 22886 tablet_service.cc:1514] Processing DeleteTablet for tablet 56914e0635284561adb64897a0dfe37c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.466045 23039 ts_tablet_manager.cc:1905] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.433662 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 with delete_type TABLET_DATA_DELETED (replaced by tablet b028cb5715bc494486dc374b47f33605) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.468209 22782 raft_consensus.cc:1270] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.445237 23226 consensus_queue.cc:1035] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.451385 23046 raft_consensus.cc:491] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.452108 23134 raft_consensus.cc:491] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.472971 22882 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.474218 22884 tablet_service.cc:1514] Processing DeleteTablet for tablet 79963c1d3d8e45e9b94908efd6487cdb with delete_type TABLET_DATA_DELETED (replaced by tablet feed94806b85451e98bc1700aa3aa7be) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.480086 22883 tablet_service.cc:1467] Processing CreateTablet for tablet d64e04a8017f4adcb9403afe8c96d6c2 (DEFAULT_TABLE table=default.Table_4922beba4a694f31b3efe0e60618b13a [id=9bafef0c07cd4377945d06cdedd6c661]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.480332 22888 tablet_service.cc:1467] Processing CreateTablet for tablet e0b164d53b73471daa541e3a7ba157ae (DEFAULT_TABLE table=default.Table_e4e402fbe40b420981cd428247f2b996 [id=ee4d5cfd47724d1c8cab66091c5194f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.485428 22885 tablet_service.cc:1467] Processing CreateTablet for tablet 704acdb3f2a64480abc8e6c9ecee3d4f (DEFAULT_TABLE table=default.Table_1233d604802d42199b1077f9349f52a0 [id=84258ef784914cafa58fadcaca594d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.495148 23034 tablet_bootstrap.cc:492] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.433974 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df5959512e2f4b23a8c275653cbce77c" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.495254 23034 ts_tablet_manager.cc:1397] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250112 21:02:32.509928 23034 raft_consensus.cc:357] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.510046 23034 raft_consensus.cc:383] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.510077 23034 raft_consensus.cc:738] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.510195 23034 consensus_queue.cc:260] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.510560 23034 ts_tablet_manager.cc:1428] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.510761 23034 tablet_bootstrap.cc:492] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.511799 23034 tablet_bootstrap.cc:654] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.491328 23046 raft_consensus.cc:513] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.512637 23046 leader_election.cc:290] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.442691 23037 tablet_bootstrap.cc:492] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.512843 23037 ts_tablet_manager.cc:1397] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
I20250112 21:02:32.513338 23037 raft_consensus.cc:357] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.513443 23037 raft_consensus.cc:383] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.513471 23037 raft_consensus.cc:738] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.513599 23037 consensus_queue.cc:260] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.513859 23037 ts_tablet_manager.cc:1428] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.514014 23037 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.514981 23037 tablet_bootstrap.cc:654] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.479712 23460 raft_consensus.cc:491] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.515489 23460 raft_consensus.cc:513] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.515857 23460 leader_election.cc:290] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.517264 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580ef2d69119418c9f4479b024491497" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.517823 22715 leader_election.cc:343] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.519951 23037 tablet_bootstrap.cc:492] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.520031 23037 ts_tablet_manager.cc:1397] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20250112 21:02:32.488062 22892 tablet_service.cc:1467] Processing CreateTablet for tablet 35759630950441598e77fafaf2857446 (DEFAULT_TABLE table=default.Table_2a41ff6ff7fd45b39a67f64a078b15bd [id=a0c7dd7ad50d472da282148fab81895f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.520557 23037 raft_consensus.cc:357] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.520651 23037 raft_consensus.cc:383] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.520680 23037 raft_consensus.cc:738] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.475783 22645 raft_consensus.cc:3054] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.521028 23037 consensus_queue.cc:260] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.521790 22645 raft_consensus.cc:1270] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.482327 22756 tablet_service.cc:1467] Processing CreateTablet for tablet d64e04a8017f4adcb9403afe8c96d6c2 (DEFAULT_TABLE table=default.Table_4922beba4a694f31b3efe0e60618b13a [id=9bafef0c07cd4377945d06cdedd6c661]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.522117 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e04a8017f4adcb9403afe8c96d6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.488807 22897 tablet_service.cc:1467] Processing CreateTablet for tablet efe46b386ae744a299ff049e8dae21e6 (DEFAULT_TABLE table=default.Table_ce5b3cd00a3d41f5bbc3309443307021 [id=825fe3188fc44127a33e4a2dda3ce771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.525012 23037 ts_tablet_manager.cc:1428] T e5515bf0f1f5419d9af6b3d82fa33e7e P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:32.476509 23499 raft_consensus.cc:491] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.525739 23499 raft_consensus.cc:513] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.526098 23499 leader_election.cc:290] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.482376 22753 tablet_service.cc:1467] Processing CreateTablet for tablet e0b164d53b73471daa541e3a7ba157ae (DEFAULT_TABLE table=default.Table_e4e402fbe40b420981cd428247f2b996 [id=ee4d5cfd47724d1c8cab66091c5194f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.526346 22753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b164d53b73471daa541e3a7ba157ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.527477 23037 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.493528 22883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e04a8017f4adcb9403afe8c96d6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.528700 22888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b164d53b73471daa541e3a7ba157ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.476644 22646 raft_consensus.cc:1270] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250112 21:02:32.482503 22755 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cbf428b373d462ca89bd39795c6ed31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.493759 23038 tablet_replica.cc:331] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.529275 23038 raft_consensus.cc:2238] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.529414 23038 raft_consensus.cc:2267] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.483175 22617 tablet_service.cc:1467] Processing CreateTablet for tablet d64e04a8017f4adcb9403afe8c96d6c2 (DEFAULT_TABLE table=default.Table_4922beba4a694f31b3efe0e60618b13a [id=9bafef0c07cd4377945d06cdedd6c661]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.529716 22617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e04a8017f4adcb9403afe8c96d6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.491360 23134 raft_consensus.cc:513] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.495014 23036 tablet_bootstrap.cc:492] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.530850 23036 ts_tablet_manager.cc:1397] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.000s
I20250112 21:02:32.531037 23134 leader_election.cc:290] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.496172 22851 leader_election.cc:304] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.531363 23036 raft_consensus.cc:357] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.531466 23036 raft_consensus.cc:383] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.483412 22612 tablet_service.cc:1467] Processing CreateTablet for tablet e0b164d53b73471daa541e3a7ba157ae (DEFAULT_TABLE table=default.Table_e4e402fbe40b420981cd428247f2b996 [id=ee4d5cfd47724d1c8cab66091c5194f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.539393 23036 raft_consensus.cc:738] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.539613 22612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b164d53b73471daa541e3a7ba157ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.539569 23036 consensus_queue.cc:260] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.539872 23036 ts_tablet_manager.cc:1428] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20250112 21:02:32.540066 23036 tablet_bootstrap.cc:492] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.506645 23548 raft_consensus.cc:491] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.540159 23548 raft_consensus.cc:513] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.540602 23548 leader_election.cc:290] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
W20250112 21:02:32.531764 22851 leader_election.cc:343] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.541424 23548 consensus_queue.cc:1035] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.483630 22614 tablet_service.cc:1467] Processing CreateTablet for tablet 35759630950441598e77fafaf2857446 (DEFAULT_TABLE table=default.Table_2a41ff6ff7fd45b39a67f64a078b15bd [id=a0c7dd7ad50d472da282148fab81895f]), partition=RANGE (key) PARTITION UNBOUNDED
W20250112 21:02:32.541648 22851 leader_election.cc:343] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:32.541679 23548 consensus_queue.cc:1035] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.541731 22614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35759630950441598e77fafaf2857446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.541996 23548 consensus_queue.cc:1035] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.487454 22887 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5 (DEFAULT_TABLE table=default.Table_1f10f6be10d94c50945e9a34000ddb76 [id=3a9ebe503f364ad68555a299e53d6b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.532045 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe46b386ae744a299ff049e8dae21e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.483829 22621 tablet_service.cc:1467] Processing CreateTablet for tablet 704acdb3f2a64480abc8e6c9ecee3d4f (DEFAULT_TABLE table=default.Table_1233d604802d42199b1077f9349f52a0 [id=84258ef784914cafa58fadcaca594d45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.543646 22621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704acdb3f2a64480abc8e6c9ecee3d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.544080 23036 tablet_bootstrap.cc:654] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.544652 22887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.488464 22618 tablet_service.cc:1467] Processing CreateTablet for tablet efe46b386ae744a299ff049e8dae21e6 (DEFAULT_TABLE table=default.Table_ce5b3cd00a3d41f5bbc3309443307021 [id=825fe3188fc44127a33e4a2dda3ce771]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.490759 22627 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5 (DEFAULT_TABLE table=default.Table_1f10f6be10d94c50945e9a34000ddb76 [id=3a9ebe503f364ad68555a299e53d6b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.496842 22644 raft_consensus.cc:3054] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.545431 22618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe46b386ae744a299ff049e8dae21e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.546437 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99cd756ca44f9788dc3d3b1bed5ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.532459 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0db56f76b0b7473bb5d70463ec5b2484" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.546939 22917 raft_consensus.cc:2463] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:32.482561 22757 tablet_service.cc:1467] Processing CreateTablet for tablet 35759630950441598e77fafaf2857446 (DEFAULT_TABLE table=default.Table_2a41ff6ff7fd45b39a67f64a078b15bd [id=a0c7dd7ad50d472da282148fab81895f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250112 21:02:32.547119 22885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 704acdb3f2a64480abc8e6c9ecee3d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.547248 22757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35759630950441598e77fafaf2857446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250112 21:02:32.532763 23118 raft_consensus.cc:491] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.548206 23118 raft_consensus.cc:513] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.548592 23118 leader_election.cc:290] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.548662 23118 raft_consensus.cc:491] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.548707 23118 raft_consensus.cc:513] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.548969 23118 leader_election.cc:290] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.484637 23065 raft_consensus.cc:491] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.549243 23065 raft_consensus.cc:513] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.549569 23065 leader_election.cc:290] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.495913 23039 ts_tablet_manager.cc:1918] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:32.549670 23039 log.cc:1198] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/56914e0635284561adb64897a0dfe37c
I20250112 21:02:32.549901 23039 ts_tablet_manager.cc:1939] T 56914e0635284561adb64897a0dfe37c P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.550442 23039 tablet_replica.cc:331] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.550578 23039 raft_consensus.cc:2238] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.550660 23039 raft_consensus.cc:2267] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.491083 23082 raft_consensus.cc:513] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.550966 23545 consensus_queue.cc:1035] T 32063752131c417abd32c5f0a8400adc P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.477819 22780 raft_consensus.cc:1270] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Refusing update from remote peer 3423673c659e4427958b13fc9eaa714d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250112 21:02:32.533335 22580 leader_election.cc:343] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:32.535454 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbdb92c2f5441796e20643a5e02a80" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.551716 22647 raft_consensus.cc:2463] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.533484 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.552559 23082 leader_election.cc:290] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.552783 22781 raft_consensus.cc:2463] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.553360 22851 leader_election.cc:304] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df
I20250112 21:02:32.553563 23545 raft_consensus.cc:2798] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.553601 23545 raft_consensus.cc:491] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.553632 23545 raft_consensus.cc:3054] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.550946 22755 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3f9cdd5b59474f953fa0099553262f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.554495 23545 raft_consensus.cc:513] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.554491 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "580ef2d69119418c9f4479b024491497" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.554811 23545 leader_election.cc:290] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.556715 22892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35759630950441598e77fafaf2857446. 1 dirs total, 0 dirs full, 0 dirs failed
W20250112 21:02:32.556856 22580 leader_election.cc:343] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.557024 22641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.557230 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.557435 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 56914e0635284561adb64897a0dfe37c (table default.Table_d709c9c11351488e8a36fe79c5cc3d6b [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:32.558017 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.558115 22914 raft_consensus.cc:2463] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:32.558261 22917 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:32.558446 22463 catalog_manager.cc:5359] Ignoring report from unknown tablet e5515bf0f1f5419d9af6b3d82fa33e7e
W20250112 21:02:32.558458 22717 leader_election.cc:343] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.558531 22717 leader_election.cc:304] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.558640 23046 raft_consensus.cc:491] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.558702 23046 raft_consensus.cc:513] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.558977 23046 leader_election.cc:290] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.559036 23552 raft_consensus.cc:2743] T 580ef2d69119418c9f4479b024491497 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.559211 22647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbdb92c2f5441796e20643a5e02a80" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
I20250112 21:02:32.559309 22647 raft_consensus.cc:3054] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.559396 22717 leader_election.cc:304] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
W20250112 21:02:32.559552 22717 leader_election.cc:343] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.559763 23552 raft_consensus.cc:2798] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.559804 23552 raft_consensus.cc:491] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.559836 23552 raft_consensus.cc:3054] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.560156 22647 raft_consensus.cc:2463] T dfdbdb92c2f5441796e20643a5e02a80 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.560390 22641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0aad32a4d5f40c69b28219f0cc42538" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.560603 22851 leader_election.cc:304] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.560772 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.534821 23038 ts_tablet_manager.cc:1905] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.561666 22582 leader_election.cc:304] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df
I20250112 21:02:32.562093 23499 raft_consensus.cc:2798] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.562145 23499 raft_consensus.cc:491] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.562186 23499 raft_consensus.cc:3054] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.562547 23552 raft_consensus.cc:513] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.562856 23038 ts_tablet_manager.cc:1918] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250112 21:02:32.562891 23552 leader_election.cc:290] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.562919 23038 log.cc:1198] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/56914e0635284561adb64897a0dfe37c
I20250112 21:02:32.563073 23499 raft_consensus.cc:513] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.563148 23038 ts_tablet_manager.cc:1939] T 56914e0635284561adb64897a0dfe37c P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.563417 23499 leader_election.cc:290] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.563521 23037 tablet_bootstrap.cc:654] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.563707 23038 tablet_replica.cc:331] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.563817 23038 raft_consensus.cc:2238] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.563896 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32063752131c417abd32c5f0a8400adc" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.564183 23046 raft_consensus.cc:2798] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.564258 23046 raft_consensus.cc:695] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.564383 23046 consensus_queue.cc:237] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.534921 23134 raft_consensus.cc:2798] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.566367 23134 raft_consensus.cc:695] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.566388 23039 ts_tablet_manager.cc:1905] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.566489 23134 consensus_queue.cc:237] T df5959512e2f4b23a8c275653cbce77c P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.569114 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 56914e0635284561adb64897a0dfe37c (table default.Table_d709c9c11351488e8a36fe79c5cc3d6b [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:32.569995 22641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
W20250112 21:02:32.570343 22715 leader_election.cc:343] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.570410 22715 leader_election.cc:304] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
W20250112 21:02:32.570406 22582 leader_election.cc:343] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.570464 22582 leader_election.cc:304] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
W20250112 21:02:32.570618 22715 leader_election.cc:343] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.570649 22582 leader_election.cc:304] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:32.570765 23552 raft_consensus.cc:2743] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.571012 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0db56f76b0b7473bb5d70463ec5b2484" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:32.571045 22644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79963c1d3d8e45e9b94908efd6487cdb" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.571081 23049 raft_consensus.cc:2743] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.571110 22914 raft_consensus.cc:3054] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.571198 23049 raft_consensus.cc:2743] T 32063752131c417abd32c5f0a8400adc P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250112 21:02:32.572036 22914 raft_consensus.cc:2463] T 0db56f76b0b7473bb5d70463ec5b2484 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:32.535593 22645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.573800 22582 leader_election.cc:304] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.574062 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet e4598f42f64b4354af0cfb53826d59e3 (table default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6]). Expected version 1 got 0
I20250112 21:02:32.574168 22463 catalog_manager.cc:5618] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.574347 23049 raft_consensus.cc:2798] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.574431 23049 raft_consensus.cc:695] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:32.574570 23049 consensus_queue.cc:237] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.574694 22465 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 77617388a31447f196febf2980f3f410 (table default.Table_275d8cd15cd3478cbf8afb8efbdcee9d [id=c8ef73a1e448490d935ef7c8e8c8846d]). Expected version 2 got 0
I20250112 21:02:32.576110 23499 raft_consensus.cc:491] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.576182 23499 raft_consensus.cc:513] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.576507 23499 leader_election.cc:290] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.576967 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.535720 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet ff5d7de8faa34adcb63f76151d8ab5e9 with delete_type TABLET_DATA_DELETED (replaced by tablet d4ac0afdf7ee4ca894d9c7375e5caef8) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.577508 23040 tablet_replica.cc:331] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:32.577646 23040 raft_consensus.cc:2238] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.577757 23040 raft_consensus.cc:2267] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.577806 23034 tablet_bootstrap.cc:492] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.577873 23034 ts_tablet_manager.cc:1397] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.000s
I20250112 21:02:32.578204 23034 raft_consensus.cc:357] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.578251 23040 ts_tablet_manager.cc:1905] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.578300 23034 raft_consensus.cc:383] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.578332 23034 raft_consensus.cc:738] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.578447 23034 consensus_queue.cc:260] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
W20250112 21:02:32.579161 22715 leader_election.cc:343] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.579408 23034 ts_tablet_manager.cc:1428] T 75c0861ef2f741faa4ad04f0da4635e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:32.579548 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6d8f7cf39be44cc8bbae6e68e97beb2" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.579591 23034 tablet_bootstrap.cc:492] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.579671 22781 raft_consensus.cc:2388] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8faec3969b64c33a4bf9aba509785ea in current term 1: Already voted for candidate 3423673c659e4427958b13fc9eaa714d in this term.
I20250112 21:02:32.580370 23040 ts_tablet_manager.cc:1918] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.580489 23040 log.cc:1198] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/ff5d7de8faa34adcb63f76151d8ab5e9
I20250112 21:02:32.580616 23034 tablet_bootstrap.cc:654] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.580699 23040 ts_tablet_manager.cc:1939] T ff5d7de8faa34adcb63f76151d8ab5e9 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:32.581280 23545 raft_consensus.cc:491] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.581357 23545 raft_consensus.cc:513] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.581384 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet ff5d7de8faa34adcb63f76151d8ab5e9 (table default.Table_c72dd11f1a2d442da8125f20836b4a2f [id=36450604cd07408a8db084947090c3b8]) successfully deleted
I20250112 21:02:32.581529 23039 ts_tablet_manager.cc:1918] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.581588 23039 log.cc:1198] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/5e6369517eed414295e2b23769bb5cf6
W20250112 21:02:32.581668 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:32.581668 23545 leader_election.cc:290] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
W20250112 21:02:32.581750 22580 leader_election.cc:343] T 0db56f76b0b7473bb5d70463ec5b2484 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 0db56f76b0b7473bb5d70463ec5b2484
I20250112 21:02:32.581797 23039 ts_tablet_manager.cc:1939] T 5e6369517eed414295e2b23769bb5cf6 P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.581928 22580 leader_election.cc:304] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:32.582106 23049 raft_consensus.cc:491] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.582163 23049 raft_consensus.cc:513] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.582406 23039 tablet_replica.cc:331] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.582449 23049 leader_election.cc:290] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.582533 23049 raft_consensus.cc:3054] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.582537 23039 raft_consensus.cc:2238] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.582626 23039 raft_consensus.cc:2267] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
W20250112 21:02:32.581384 22851 leader_election.cc:343] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.582794 22851 leader_election.cc:343] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.582863 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 5e6369517eed414295e2b23769bb5cf6 (table default.Table_bb9d38734f9a463c9c2ac8d4e54e80a0 [id=bcd2eb00ebd84c87b74c9e871ee650d7]) successfully deleted
W20250112 21:02:32.582890 22851 leader_election.cc:343] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.583034 22450 catalog_manager.cc:4839] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): delete failed for tablet 6cbf428b373d462ca89bd39795c6ed31 because the tablet was not found. No further retry: Not found: Tablet not found: 6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.583050 22851 leader_election.cc:304] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.583046 23545 consensus_queue.cc:1035] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:32.583264 22851 leader_election.cc:343] T dfdbdb92c2f5441796e20643a5e02a80 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:32.583329 23545 raft_consensus.cc:2798] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.583367 23545 raft_consensus.cc:491] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.583380 23049 raft_consensus.cc:2743] T b6d8f7cf39be44cc8bbae6e68e97beb2 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250112 21:02:32.583401 22851 leader_election.cc:343] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:32.583400 23545 raft_consensus.cc:3054] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.583469 22851 leader_election.cc:304] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
W20250112 21:02:32.583714 22851 leader_election.cc:343] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: 79963c1d3d8e45e9b94908efd6487cdb
I20250112 21:02:32.583765 22851 leader_election.cc:304] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.583784 23546 raft_consensus.cc:2743] T f0aad32a4d5f40c69b28219f0cc42538 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.584306 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c73dce51147e29837df3b364af790" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.584307 23545 raft_consensus.cc:513] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.584424 22781 raft_consensus.cc:2463] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 0.
I20250112 21:02:32.584556 23548 raft_consensus.cc:2743] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.584625 23545 leader_election.cc:290] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.563905 23038 raft_consensus.cc:2267] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.584728 22580 leader_election.cc:304] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.584794 23039 ts_tablet_manager.cc:1905] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.584857 23049 raft_consensus.cc:2798] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.584890 23049 raft_consensus.cc:491] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.584919 23049 raft_consensus.cc:3054] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.585646 23049 raft_consensus.cc:513] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.585948 23049 leader_election.cc:290] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Requested vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.586123 23038 ts_tablet_manager.cc:1905] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.586767 23039 ts_tablet_manager.cc:1918] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.586827 23039 log.cc:1198] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/1d3f9cdd5b59474f953fa0099553262f
I20250112 21:02:32.587002 23039 ts_tablet_manager.cc:1939] T 1d3f9cdd5b59474f953fa0099553262f P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.587393 22781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d19c73dce51147e29837df3b364af790" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.587502 22781 raft_consensus.cc:3054] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.587862 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet 1d3f9cdd5b59474f953fa0099553262f (table default.Table_9d4cd578620c44e4991b125af874b287 [id=e520a81a194548d3b0079e13a5d886ba]) successfully deleted
I20250112 21:02:32.588073 23038 ts_tablet_manager.cc:1918] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.588120 23038 log.cc:1198] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/5a057bfc6f20435fb6b6d0dacff66136
I20250112 21:02:32.588308 23038 ts_tablet_manager.cc:1939] T 5a057bfc6f20435fb6b6d0dacff66136 P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.588351 22781 raft_consensus.cc:2463] T d19c73dce51147e29837df3b364af790 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8faec3969b64c33a4bf9aba509785ea in term 1.
I20250112 21:02:32.589630 22644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
W20250112 21:02:32.589864 22851 leader_election.cc:343] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Not found: Tablet not found: b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:32.589974 22778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.590090 22778 raft_consensus.cc:2388] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3423673c659e4427958b13fc9eaa714d in current term 1: Already voted for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in this term.
I20250112 21:02:32.590394 22580 leader_election.cc:304] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea; no voters:
I20250112 21:02:32.590786 23134 consensus_queue.cc:1035] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.591315 22883 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c50b95d782e420a8e32acf58f95d85a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.593246 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "416a58323f314344a297decdcc2f70df" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:32.593369 22914 raft_consensus.cc:2388] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0b63e675bcb141f3a7887ea5ef9ed2df in current term 1: Already voted for candidate 3423673c659e4427958b13fc9eaa714d in this term.
W20250112 21:02:32.593608 22582 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: d19c73dce51147e29837df3b364af790
I20250112 21:02:32.593793 23036 tablet_bootstrap.cc:492] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.593875 23036 ts_tablet_manager.cc:1397] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20250112 21:02:32.594017 23499 raft_consensus.cc:2798] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.594096 23499 raft_consensus.cc:695] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [term 1 LEADER]: Becoming Leader. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Running, Role: LEADER
I20250112 21:02:32.594211 23499 consensus_queue.cc:237] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } }
I20250112 21:02:32.594354 23036 raft_consensus.cc:357] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.594444 23036 raft_consensus.cc:383] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.594475 23036 raft_consensus.cc:738] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.594580 23036 consensus_queue.cc:260] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.594843 23036 ts_tablet_manager.cc:1428] T 580ef2d69119418c9f4479b024491497 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20250112 21:02:32.594935 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet df5959512e2f4b23a8c275653cbce77c
W20250112 21:02:32.594980 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet dfdbdb92c2f5441796e20643a5e02a80
I20250112 21:02:32.595010 23036 tablet_bootstrap.cc:492] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.595993 23036 tablet_bootstrap.cc:654] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:32.596135 22851 leader_election.cc:343] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): Not found: Tablet not found: b40002b2a71741d9833974adc89e0c4e
I20250112 21:02:32.596386 22851 leader_election.cc:304] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.596606 23548 raft_consensus.cc:2743] T b40002b2a71741d9833974adc89e0c4e P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.596928 22717 leader_election.cc:304] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
W20250112 21:02:32.596815 22851 leader_election.cc:343] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.597007 22851 leader_election.cc:304] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3423673c659e4427958b13fc9eaa714d; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.597218 23552 raft_consensus.cc:2743] T 416a58323f314344a297decdcc2f70df P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20250112 21:02:32.597307 22582 leader_election.cc:343] T d19c73dce51147e29837df3b364af790 P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Not found: Tablet not found: d19c73dce51147e29837df3b364af790
I20250112 21:02:32.601706 23548 raft_consensus.cc:2743] T 416a58323f314344a297decdcc2f70df P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.602811 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet e4598f42f64b4354af0cfb53826d59e3 (table default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6]). Expected version 1 got 0
W20250112 21:02:32.603039 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet d19c73dce51147e29837df3b364af790
I20250112 21:02:32.603235 23036 tablet_bootstrap.cc:492] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.603320 23036 ts_tablet_manager.cc:1397] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20250112 21:02:32.603767 23036 raft_consensus.cc:357] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.604166 23036 raft_consensus.cc:383] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.604249 23036 raft_consensus.cc:738] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.604458 23036 consensus_queue.cc:260] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.604919 23036 ts_tablet_manager.cc:1428] T f944f0d5e5994fd5abb2ed2c991a3eef P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:32.606015 23046 consensus_queue.cc:1035] T b6d8f7cf39be44cc8bbae6e68e97beb2 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:32.607914 22851 consensus_peers.cc:487] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d -> Peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Couldn't send request to peer d8faec3969b64c33a4bf9aba509785ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250112 21:02:32.608119 23036 tablet_bootstrap.cc:492] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.610401 23036 tablet_bootstrap.cc:654] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.612959 23038 tablet_replica.cc:331] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.613055 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 5a057bfc6f20435fb6b6d0dacff66136 (table default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]) successfully deleted
I20250112 21:02:32.613196 23038 raft_consensus.cc:2238] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.613301 23038 raft_consensus.cc:2267] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.614637 23038 ts_tablet_manager.cc:1905] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.617952 23084 tablet.cc:1721] T 77617388a31447f196febf2980f3f410 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:32.619010 23497 tablet.cc:1721] T 77617388a31447f196febf2980f3f410 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:32.621444 23082 raft_consensus.cc:491] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.621569 23082 raft_consensus.cc:513] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.621963 23082 leader_election.cc:290] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913), d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893)
I20250112 21:02:32.622396 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f17a824b8c42ee8d7677e78ba77f9f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.622799 22715 leader_election.cc:343] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.623087 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81f17a824b8c42ee8d7677e78ba77f9f" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:32.623831 22717 leader_election.cc:343] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.623901 22717 leader_election.cc:304] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.624352 23084 tablet.cc:1721] T e4598f42f64b4354af0cfb53826d59e3 P 3423673c659e4427958b13fc9eaa714d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.624825 23354 tablet.cc:1721] T e4598f42f64b4354af0cfb53826d59e3 P d8faec3969b64c33a4bf9aba509785ea: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.625322 23082 raft_consensus.cc:2743] T 81f17a824b8c42ee8d7677e78ba77f9f P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.617269 23038 ts_tablet_manager.cc:1918] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.627688 23038 log.cc:1198] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/79963c1d3d8e45e9b94908efd6487cdb
I20250112 21:02:32.627925 23038 ts_tablet_manager.cc:1939] T 79963c1d3d8e45e9b94908efd6487cdb P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.628206 23406 tablet.cc:1721] T 77617388a31447f196febf2980f3f410 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250112 21:02:32.628906 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 79963c1d3d8e45e9b94908efd6487cdb (table default.Table_3fb2f846f6b64ccd953c87ac3c974c10 [id=ced9cef66e3f42eeac86c91e13bc41b0]) successfully deleted
W20250112 21:02:32.629317 22452 catalog_manager.cc:4839] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): delete failed for tablet 6cbf428b373d462ca89bd39795c6ed31 because the tablet was not found. No further retry: Not found: Tablet not found: 6cbf428b373d462ca89bd39795c6ed31
I20250112 21:02:32.630686 23038 tablet_replica.cc:331] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.630872 23038 raft_consensus.cc:2238] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.631009 23038 raft_consensus.cc:2267] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.631712 23038 ts_tablet_manager.cc:1905] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.642345 23038 ts_tablet_manager.cc:1918] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.642513 23038 log.cc:1198] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/0c50b95d782e420a8e32acf58f95d85a
I20250112 21:02:32.642772 23038 ts_tablet_manager.cc:1939] T 0c50b95d782e420a8e32acf58f95d85a P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.643481 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet 0c50b95d782e420a8e32acf58f95d85a (table default.Table_97936dd45d9b496cbbd47d899dfa6433 [id=2bf2e96a3eb84993826a17d1616421b7]) successfully deleted
I20250112 21:02:32.644246 22463 catalog_manager.cc:6071] T 00000000000000000000000000000000 P a8456e9572be47fabce002f001805c33: default.Table_93d3f705b83f46e99475a154b7e1933e [id=3a53c2f5d23c457eb8621b1f017badf6] alter complete (version 1)
I20250112 21:02:32.646687 23034 tablet_bootstrap.cc:492] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.646799 23034 ts_tablet_manager.cc:1397] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.000s
I20250112 21:02:32.647228 23034 raft_consensus.cc:357] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.647351 23034 raft_consensus.cc:383] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.647384 23034 raft_consensus.cc:738] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.647511 23034 consensus_queue.cc:260] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.647843 23034 ts_tablet_manager.cc:1428] T 6d727069e2614af5a7d1d40a6035b2e8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.648167 23034 tablet_bootstrap.cc:492] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.649114 23501 tablet.cc:1721] T e4598f42f64b4354af0cfb53826d59e3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250112 21:02:32.649194 23034 tablet_bootstrap.cc:654] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.651851 23036 tablet_bootstrap.cc:492] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.651942 23036 ts_tablet_manager.cc:1397] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20250112 21:02:32.652068 23037 tablet_bootstrap.cc:492] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.652159 23037 ts_tablet_manager.cc:1397] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.125s user 0.000s sys 0.002s
I20250112 21:02:32.652544 23036 raft_consensus.cc:357] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.652652 23036 raft_consensus.cc:383] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.652701 23036 raft_consensus.cc:738] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.652683 23037 raft_consensus.cc:357] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.652799 23037 raft_consensus.cc:383] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.652832 23037 raft_consensus.cc:738] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.652801 23036 consensus_queue.cc:260] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.652943 23037 consensus_queue.cc:260] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.653059 23036 ts_tablet_manager.cc:1428] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.653234 23037 ts_tablet_manager.cc:1428] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20250112 21:02:32.653252 23036 tablet_bootstrap.cc:492] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.653427 23037 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.654199 23036 tablet_bootstrap.cc:654] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.654351 23037 tablet_bootstrap.cc:654] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.658458 23037 tablet_bootstrap.cc:492] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.658596 23037 ts_tablet_manager.cc:1397] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:32.659051 23037 raft_consensus.cc:357] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.659214 23037 raft_consensus.cc:383] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.659279 23037 raft_consensus.cc:738] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.659477 23037 consensus_queue.cc:260] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.659873 23037 ts_tablet_manager.cc:1428] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.660071 23037 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.663201 23037 tablet_bootstrap.cc:654] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.663928 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 6d727069e2614af5a7d1d40a6035b2e8 (table default.Table_1b129250f2c44cb0a094e1d875052ce0 [id=49c5d4af135743bf9883af3ace89ce22]). Expected version 2 got 0
I20250112 21:02:32.664625 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 56914e0635284561adb64897a0dfe37c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.664800 23040 tablet_replica.cc:331] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:32.664920 23040 raft_consensus.cc:2238] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.665022 23040 raft_consensus.cc:2267] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.665565 23040 ts_tablet_manager.cc:1905] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.667644 23040 ts_tablet_manager.cc:1918] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.667711 23040 log.cc:1198] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/56914e0635284561adb64897a0dfe37c
I20250112 21:02:32.667888 23040 ts_tablet_manager.cc:1939] T 56914e0635284561adb64897a0dfe37c P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:32.669356 23036 tablet_bootstrap.cc:492] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.669409 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 56914e0635284561adb64897a0dfe37c (table default.Table_d709c9c11351488e8a36fe79c5cc3d6b [id=83aa4d12b5d24a628351eb0a6b975cb7]) successfully deleted
I20250112 21:02:32.669450 23036 ts_tablet_manager.cc:1397] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250112 21:02:32.669935 23036 raft_consensus.cc:357] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.670038 23036 raft_consensus.cc:383] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.670068 23036 raft_consensus.cc:738] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.670182 23036 consensus_queue.cc:260] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.670435 23036 ts_tablet_manager.cc:1428] T 75c0861ef2f741faa4ad04f0da4635e3 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.670619 23036 tablet_bootstrap.cc:492] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
W20250112 21:02:32.671011 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet f2b088a5d5eb423e87d1542eaded5cd7
I20250112 21:02:32.671581 23036 tablet_bootstrap.cc:654] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.675514 23034 tablet_bootstrap.cc:492] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.675607 23034 ts_tablet_manager.cc:1397] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20250112 21:02:32.676038 23034 raft_consensus.cc:357] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.676129 23034 raft_consensus.cc:383] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.676156 23034 raft_consensus.cc:738] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.676263 23034 consensus_queue.cc:260] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.676898 23034 ts_tablet_manager.cc:1428] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.677059 23034 tablet_bootstrap.cc:492] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.677966 23034 tablet_bootstrap.cc:654] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.683236 22755 tablet_service.cc:1514] Processing DeleteTablet for tablet bd52409ed391433491b65bb00d33b36a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:44696
I20250112 21:02:32.683492 23039 tablet_replica.cc:331] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: stopping tablet replica
I20250112 21:02:32.683630 23039 raft_consensus.cc:2238] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.683732 23039 raft_consensus.cc:2267] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.684150 23039 ts_tablet_manager.cc:1905] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.684916 23036 tablet_bootstrap.cc:492] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.684985 23036 ts_tablet_manager.cc:1397] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250112 21:02:32.685379 23036 raft_consensus.cc:357] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.685477 23036 raft_consensus.cc:383] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.685514 23036 raft_consensus.cc:738] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.685619 23036 consensus_queue.cc:260] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.685868 23036 ts_tablet_manager.cc:1428] T 6d727069e2614af5a7d1d40a6035b2e8 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.686053 23036 tablet_bootstrap.cc:492] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.686232 23039 ts_tablet_manager.cc:1918] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.686297 23039 log.cc:1198] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-1/wal/wals/bd52409ed391433491b65bb00d33b36a
I20250112 21:02:32.686470 23039 ts_tablet_manager.cc:1939] T bd52409ed391433491b65bb00d33b36a P 0b63e675bcb141f3a7887ea5ef9ed2df: Deleting consensus metadata
I20250112 21:02:32.687143 23036 tablet_bootstrap.cc:654] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.687302 22450 catalog_manager.cc:4872] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011): tablet bd52409ed391433491b65bb00d33b36a (table default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]) successfully deleted
I20250112 21:02:32.688115 23036 tablet_bootstrap.cc:492] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.688190 23036 ts_tablet_manager.cc:1397] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20250112 21:02:32.688529 23034 tablet_bootstrap.cc:492] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.688614 23034 ts_tablet_manager.cc:1397] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20250112 21:02:32.688622 23036 raft_consensus.cc:357] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.688707 23036 raft_consensus.cc:383] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.688732 23036 raft_consensus.cc:738] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.688817 23036 consensus_queue.cc:260] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.689105 23036 ts_tablet_manager.cc:1428] T 341765719b0d42168aafad19e5b4cc61 P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.689070 23034 raft_consensus.cc:357] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.689168 23034 raft_consensus.cc:383] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.689198 23034 raft_consensus.cc:738] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.689237 23036 tablet_bootstrap.cc:492] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.689538 23034 consensus_queue.cc:260] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.690753 23036 tablet_bootstrap.cc:654] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.690898 23034 ts_tablet_manager.cc:1428] T 0b7486a9a641437fa13470ff586d3567 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250112 21:02:32.691129 23034 tablet_bootstrap.cc:492] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.691650 23036 tablet_bootstrap.cc:492] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.691717 23036 ts_tablet_manager.cc:1397] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20250112 21:02:32.692077 23036 raft_consensus.cc:357] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.692157 23036 raft_consensus.cc:383] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.692183 23036 raft_consensus.cc:738] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.692274 23036 consensus_queue.cc:260] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.692525 23036 ts_tablet_manager.cc:1428] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.692662 23036 tablet_bootstrap.cc:492] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.693459 23036 tablet_bootstrap.cc:654] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:32.694429 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet 0b7486a9a641437fa13470ff586d3567
I20250112 21:02:32.695598 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 55779970251c4f819e1e3405de0bc30b (table default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]). Expected version 3 got 0
I20250112 21:02:32.695689 22458 catalog_manager.cc:5618] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913) does not have the latest schema for tablet 6d727069e2614af5a7d1d40a6035b2e8 (table default.Table_1b129250f2c44cb0a094e1d875052ce0 [id=49c5d4af135743bf9883af3ace89ce22]). Expected version 2 got 0
I20250112 21:02:32.698879 23034 tablet_bootstrap.cc:654] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.701905 23548 consensus_queue.cc:1035] T 7d5332ec945740f0a998b1fb9848387a P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250112 21:02:32.703557 23082 raft_consensus.cc:491] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.703635 23082 raft_consensus.cc:513] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.703975 23037 tablet_bootstrap.cc:492] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.703972 23082 leader_election.cc:290] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.704068 23037 ts_tablet_manager.cc:1397] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20250112 21:02:32.704429 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55779970251c4f819e1e3405de0bc30b" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.704784 22715 leader_election.cc:343] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.704748 23037 raft_consensus.cc:357] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.704840 23037 raft_consensus.cc:383] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.704869 23037 raft_consensus.cc:738] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.704998 23037 consensus_queue.cc:260] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.705101 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55779970251c4f819e1e3405de0bc30b" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.705199 22916 raft_consensus.cc:2463] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 0.
I20250112 21:02:32.705299 23037 ts_tablet_manager.cc:1428] T f0aad32a4d5f40c69b28219f0cc42538 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20250112 21:02:32.705488 23037 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.706617 22717 leader_election.cc:304] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.706686 23037 tablet_bootstrap.cc:654] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.707103 23082 raft_consensus.cc:2798] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.707159 23082 raft_consensus.cc:491] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.707194 23082 raft_consensus.cc:3054] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
W20250112 21:02:32.707777 22458 catalog_manager.cc:5359] Ignoring report from unknown tablet f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:32.708148 23082 raft_consensus.cc:513] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.708527 23082 leader_election.cc:290] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.709170 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55779970251c4f819e1e3405de0bc30b" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
W20250112 21:02:32.709486 22715 leader_election.cc:343] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.709748 22458 catalog_manager.cc:5359] Ignoring report from unknown tablet f0aad32a4d5f40c69b28219f0cc42538
I20250112 21:02:32.710748 23037 tablet_bootstrap.cc:492] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.710827 23037 ts_tablet_manager.cc:1397] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20250112 21:02:32.710947 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55779970251c4f819e1e3405de0bc30b" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d"
I20250112 21:02:32.711040 22916 raft_consensus.cc:3054] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.711274 23037 raft_consensus.cc:357] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.711357 23037 raft_consensus.cc:383] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.711381 23037 raft_consensus.cc:738] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.711493 23037 consensus_queue.cc:260] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.711740 23037 ts_tablet_manager.cc:1428] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.711903 23037 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.712030 22916 raft_consensus.cc:2463] T 55779970251c4f819e1e3405de0bc30b P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b63e675bcb141f3a7887ea5ef9ed2df in term 1.
I20250112 21:02:32.712723 22717 leader_election.cc:304] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters: d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.712863 23037 tablet_bootstrap.cc:654] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.715427 22617 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a057bfc6f20435fb6b6d0dacff66136 with delete_type TABLET_DATA_DELETED (replaced by tablet b028cb5715bc494486dc374b47f33605) from {username='slave'} at 127.0.0.1:38002
I20250112 21:02:32.715674 23040 tablet_replica.cc:331] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: stopping tablet replica
I20250112 21:02:32.715816 23040 raft_consensus.cc:2238] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.715907 23040 raft_consensus.cc:2267] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.716586 23082 raft_consensus.cc:2798] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.716677 23082 raft_consensus.cc:695] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 LEADER]: Becoming Leader. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Running, Role: LEADER
I20250112 21:02:32.716799 23082 consensus_queue.cc:237] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.717285 23040 ts_tablet_manager.cc:1905] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.719491 23040 ts_tablet_manager.cc:1918] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.719563 23040 log.cc:1198] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-0/wal/wals/5a057bfc6f20435fb6b6d0dacff66136
I20250112 21:02:32.719748 23040 ts_tablet_manager.cc:1939] T 5a057bfc6f20435fb6b6d0dacff66136 P d8faec3969b64c33a4bf9aba509785ea: Deleting consensus metadata
I20250112 21:02:32.720631 22450 catalog_manager.cc:4872] TS d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): tablet 5a057bfc6f20435fb6b6d0dacff66136 (table default.Table_c85c6a076cbb4a1fa4d31c684995ad5b [id=6ab55597faed4d8bb81acf2f9cbc9769]) successfully deleted
I20250112 21:02:32.722008 23037 tablet_bootstrap.cc:492] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.722092 23037 ts_tablet_manager.cc:1397] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20250112 21:02:32.722520 23037 raft_consensus.cc:357] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.722623 23037 raft_consensus.cc:383] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.722653 23037 raft_consensus.cc:738] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.722759 23037 consensus_queue.cc:260] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.722929 23036 tablet_bootstrap.cc:492] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.723008 23036 ts_tablet_manager.cc:1397] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.000s
I20250112 21:02:32.723008 23037 ts_tablet_manager.cc:1428] T df5959512e2f4b23a8c275653cbce77c P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.723176 23037 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.723449 23036 raft_consensus.cc:357] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.723549 23036 raft_consensus.cc:383] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.723580 23036 raft_consensus.cc:738] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.723702 23036 consensus_queue.cc:260] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.723948 23036 ts_tablet_manager.cc:1428] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.724110 23037 tablet_bootstrap.cc:654] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.724143 23036 tablet_bootstrap.cc:492] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.725183 23036 tablet_bootstrap.cc:654] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.726964 22458 catalog_manager.cc:5526] T 55779970251c4f819e1e3405de0bc30b P 0b63e675bcb141f3a7887ea5ef9ed2df reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194). New cstate: current_term: 1 leader_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } health_report { overall_health: UNKNOWN } } }
I20250112 21:02:32.727167 22458 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 55779970251c4f819e1e3405de0bc30b (table default.Table_19a92ad89b0b4e24984ba4442cda25f5 [id=490ed39e4b39477896146f5b117fb296]). Expected version 3 got 0
I20250112 21:02:32.728340 23034 tablet_bootstrap.cc:492] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.728456 23034 ts_tablet_manager.cc:1397] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20250112 21:02:32.728909 23034 raft_consensus.cc:357] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.729010 23034 raft_consensus.cc:383] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.729041 23034 raft_consensus.cc:738] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.729154 23034 consensus_queue.cc:260] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.729435 23034 ts_tablet_manager.cc:1428] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.729616 23034 tablet_bootstrap.cc:492] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.730556 23034 tablet_bootstrap.cc:654] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
W20250112 21:02:32.731525 22465 catalog_manager.cc:5359] Ignoring report from unknown tablet df5959512e2f4b23a8c275653cbce77c
I20250112 21:02:32.737090 22883 tablet_service.cc:1514] Processing DeleteTablet for tablet bd52409ed391433491b65bb00d33b36a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.738008 23038 tablet_replica.cc:331] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.738143 23038 raft_consensus.cc:2238] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.738267 23038 raft_consensus.cc:2267] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.739492 23038 ts_tablet_manager.cc:1905] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.741729 23038 ts_tablet_manager.cc:1918] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.741796 23038 log.cc:1198] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/bd52409ed391433491b65bb00d33b36a
I20250112 21:02:32.741982 23038 ts_tablet_manager.cc:1939] T bd52409ed391433491b65bb00d33b36a P 3423673c659e4427958b13fc9eaa714d: Deleting consensus metadata
I20250112 21:02:32.744151 23049 raft_consensus.cc:491] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.744246 23049 raft_consensus.cc:513] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.744676 23049 leader_election.cc:290] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.745101 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.745687 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d5332ec945740f0a998b1fb9848387a" candidate_uuid: "d8faec3969b64c33a4bf9aba509785ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
I20250112 21:02:32.746086 22582 leader_election.cc:304] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8faec3969b64c33a4bf9aba509785ea; no voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d
I20250112 21:02:32.746496 22463 catalog_manager.cc:5618] TS 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011) does not have the latest schema for tablet 780991d6673a4987a450413a808d2026 (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c]). Expected version 1 got 0
W20250112 21:02:32.746902 22463 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 780991d6673a4987a450413a808d2026 (table default.Table_9ab2546cb10f4ef98142d1ba7f737471 [id=3ad1f68c588b4d41ac36e52abcca581c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 780991d6673a4987a450413a808d2026 consensus state has no leader
I20250112 21:02:32.747120 23049 raft_consensus.cc:2743] T 7d5332ec945740f0a998b1fb9848387a P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.748353 22452 catalog_manager.cc:4872] TS 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): tablet bd52409ed391433491b65bb00d33b36a (table default.Table_78295df1f6bd4a6694a742e692d31fa5 [id=91a947a84fd54a2f98fd775bc513eedf]) successfully deleted
I20250112 21:02:32.748625 23037 tablet_bootstrap.cc:492] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.748714 23037 ts_tablet_manager.cc:1397] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20250112 21:02:32.749172 23037 raft_consensus.cc:357] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.749274 23037 raft_consensus.cc:383] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.749423 23037 raft_consensus.cc:738] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.749598 23037 consensus_queue.cc:260] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.752691 23037 ts_tablet_manager.cc:1428] T 78e83f9dc722400bbbd3114156318ac4 P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250112 21:02:32.755100 23134 raft_consensus.cc:491] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.755199 23134 raft_consensus.cc:513] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.755616 23134 leader_election.cc:290] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.756107 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" is_pre_election: true
I20250112 21:02:32.756228 22782 raft_consensus.cc:2463] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 0.
I20250112 21:02:32.756503 22851 leader_election.cc:304] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.756892 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
I20250112 21:02:32.757002 23134 raft_consensus.cc:2798] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250112 21:02:32.757048 23134 raft_consensus.cc:491] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250112 21:02:32.757082 23134 raft_consensus.cc:3054] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.758083 23134 raft_consensus.cc:513] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.758289 23037 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.758419 23134 leader_election.cc:290] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Requested vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 0b63e675bcb141f3a7887ea5ef9ed2df (127.21.194.194:41011)
I20250112 21:02:32.758957 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df"
I20250112 21:02:32.759063 22782 raft_consensus.cc:3054] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Advancing to term 1
I20250112 21:02:32.759346 23037 tablet_bootstrap.cc:654] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.760026 22782 raft_consensus.cc:2463] T f2b088a5d5eb423e87d1542eaded5cd7 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3423673c659e4427958b13fc9eaa714d in term 1.
I20250112 21:02:32.760483 22851 leader_election.cc:304] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df, 3423673c659e4427958b13fc9eaa714d; no voters:
I20250112 21:02:32.760967 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b088a5d5eb423e87d1542eaded5cd7" candidate_uuid: "3423673c659e4427958b13fc9eaa714d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea"
W20250112 21:02:32.761092 22851 leader_election.cc:343] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
W20250112 21:02:32.761490 22851 leader_election.cc:343] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.761942 23036 tablet_bootstrap.cc:492] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.762002 23036 ts_tablet_manager.cc:1397] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20250112 21:02:32.762362 23036 raft_consensus.cc:357] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.762431 23036 raft_consensus.cc:383] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.762450 23036 raft_consensus.cc:738] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.762550 23036 consensus_queue.cc:260] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.762684 23545 raft_consensus.cc:2798] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 1 FOLLOWER]: Leader election won for term 1
I20250112 21:02:32.762753 23545 raft_consensus.cc:695] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [term 1 LEADER]: Becoming Leader. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Running, Role: LEADER
I20250112 21:02:32.762809 23036 ts_tablet_manager.cc:1428] T 81f17a824b8c42ee8d7677e78ba77f9f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.762861 23545 consensus_queue.cc:237] T f2b088a5d5eb423e87d1542eaded5cd7 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.762988 23036 tablet_bootstrap.cc:492] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.763911 23036 tablet_bootstrap.cc:654] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.765616 23034 tablet_bootstrap.cc:492] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.765699 23034 ts_tablet_manager.cc:1397] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20250112 21:02:32.766155 23034 raft_consensus.cc:357] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.766250 23034 raft_consensus.cc:383] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.766292 23034 raft_consensus.cc:738] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.766407 23034 consensus_queue.cc:260] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.766669 23034 ts_tablet_manager.cc:1428] T 157b61dc4def4c64aa6046c696ca28b8 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.766847 23034 tablet_bootstrap.cc:492] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.767730 23034 tablet_bootstrap.cc:654] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.770650 23065 raft_consensus.cc:491] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250112 21:02:32.770735 23065 raft_consensus.cc:513] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.771072 23065 leader_election.cc:290] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893), 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913)
I20250112 21:02:32.771498 22643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780991d6673a4987a450413a808d2026" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8faec3969b64c33a4bf9aba509785ea" is_pre_election: true
W20250112 21:02:32.771831 22715 leader_election.cc:343] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8faec3969b64c33a4bf9aba509785ea (127.21.194.193:40893): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.773222 22916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "780991d6673a4987a450413a808d2026" candidate_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3423673c659e4427958b13fc9eaa714d" is_pre_election: true
W20250112 21:02:32.773566 22458 catalog_manager.cc:5359] Ignoring report from unknown tablet f2b088a5d5eb423e87d1542eaded5cd7
I20250112 21:02:32.774205 23134 consensus_queue.cc:1035] T 65b0da9ee2d545e8acef16ad06ac1966 P 3423673c659e4427958b13fc9eaa714d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250112 21:02:32.775329 22717 leader_election.cc:343] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3423673c659e4427958b13fc9eaa714d (127.21.194.195:42913): Illegal state: must be running to vote when last-logged opid is not known
I20250112 21:02:32.775403 22717 leader_election.cc:304] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0b63e675bcb141f3a7887ea5ef9ed2df; no voters: 3423673c659e4427958b13fc9eaa714d, d8faec3969b64c33a4bf9aba509785ea
I20250112 21:02:32.774291 23036 tablet_bootstrap.cc:492] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: No bootstrap required, opened a new log
I20250112 21:02:32.775648 23036 ts_tablet_manager.cc:1397] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20250112 21:02:32.775920 23037 tablet_bootstrap.cc:492] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea: No bootstrap required, opened a new log
I20250112 21:02:32.776010 23037 ts_tablet_manager.cc:1397] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250112 21:02:32.776069 23036 raft_consensus.cc:357] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.776162 23036 raft_consensus.cc:383] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.776192 23036 raft_consensus.cc:738] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3423673c659e4427958b13fc9eaa714d, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.776211 23065 raft_consensus.cc:2743] T 780991d6673a4987a450413a808d2026 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250112 21:02:32.776300 23036 consensus_queue.cc:260] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } }
I20250112 21:02:32.776494 23037 raft_consensus.cc:357] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.776593 23036 ts_tablet_manager.cc:1428] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.776602 23037 raft_consensus.cc:383] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.776630 23037 raft_consensus.cc:738] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8faec3969b64c33a4bf9aba509785ea, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.776732 23037 consensus_queue.cc:260] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.776907 23036 tablet_bootstrap.cc:492] T 0b7486a9a641437fa13470ff586d3567 P 3423673c659e4427958b13fc9eaa714d: Bootstrap starting.
I20250112 21:02:32.776981 23037 ts_tablet_manager.cc:1428] T 416a58323f314344a297decdcc2f70df P d8faec3969b64c33a4bf9aba509785ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250112 21:02:32.777124 23037 tablet_bootstrap.cc:492] T f944f0d5e5994fd5abb2ed2c991a3eef P d8faec3969b64c33a4bf9aba509785ea: Bootstrap starting.
I20250112 21:02:32.778033 23037 tablet_bootstrap.cc:654] T f944f0d5e5994fd5abb2ed2c991a3eef P d8faec3969b64c33a4bf9aba509785ea: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.778242 23036 tablet_bootstrap.cc:654] T 0b7486a9a641437fa13470ff586d3567 P 3423673c659e4427958b13fc9eaa714d: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.783133 23034 tablet_bootstrap.cc:492] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df: No bootstrap required, opened a new log
I20250112 21:02:32.783231 23034 ts_tablet_manager.cc:1397] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20250112 21:02:32.783705 23034 raft_consensus.cc:357] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.783812 23034 raft_consensus.cc:383] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250112 21:02:32.783838 23034 raft_consensus.cc:738] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b63e675bcb141f3a7887ea5ef9ed2df, State: Initialized, Role: FOLLOWER
I20250112 21:02:32.783939 23034 consensus_queue.cc:260] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8faec3969b64c33a4bf9aba509785ea" member_type: VOTER last_known_addr { host: "127.21.194.193" port: 40893 } } peers { permanent_uuid: "3423673c659e4427958b13fc9eaa714d" member_type: VOTER last_known_addr { host: "127.21.194.195" port: 42913 } } peers { permanent_uuid: "0b63e675bcb141f3a7887ea5ef9ed2df" member_type: VOTER last_known_addr { host: "127.21.194.194" port: 41011 } }
I20250112 21:02:32.784222 23034 ts_tablet_manager.cc:1428] T 714d50b52c7a4bc0ad3fd0b029bb6693 P 0b63e675bcb141f3a7887ea5ef9ed2df: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250112 21:02:32.784430 23034 tablet_bootstrap.cc:492] T d2e37d9a5e9f4973b718f7aa14ca6ab3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Bootstrap starting.
I20250112 21:02:32.784583 22883 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3f9cdd5b59474f953fa0099553262f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-12 21:02:32 UTC) from {username='slave'} at 127.0.0.1:50006
I20250112 21:02:32.784737 23038 tablet_replica.cc:331] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: stopping tablet replica
I20250112 21:02:32.784847 23038 raft_consensus.cc:2238] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus shutting down.
I20250112 21:02:32.784934 23038 raft_consensus.cc:2267] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d [term 0 FOLLOWER]: Raft consensus is shut down!
I20250112 21:02:32.785382 23034 tablet_bootstrap.cc:654] T d2e37d9a5e9f4973b718f7aa14ca6ab3 P 0b63e675bcb141f3a7887ea5ef9ed2df: Neither blocks nor log segments found. Creating new log.
I20250112 21:02:32.785440 23038 ts_tablet_manager.cc:1905] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250112 21:02:32.787443 23038 ts_tablet_manager.cc:1918] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250112 21:02:32.787494 23038 log.cc:1198] T 1d3f9cdd5b59474f953fa0099553262f P 3423673c659e4427958b13fc9eaa714d: Deleting WAL directory at /tmp/dist-test-task2b0lOt/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736715748299339-22283-0/minicluster-data/ts-2/wal/wals/1d3f9cdd5b59474f953fa0099553262f